METHODS FOR ALIGNMENT OF PLAN TO EXECUTION USING MULTIMODAL CUES FOR SCRIPT-BASED PERFORMANCE MONITORING

Number: 20260228048
Published: 2026-08-06
Filed: 2025-01-31
Assignee: DISNEY ENTERPRISES, INC.
Inventors: MOEN; Erick Kevin, BANGALORE KANTHARAJU; Reshmashree, DONG; Bo, KUMAR; Komath Naveen, FIDALEO; Douglas A., UM; Seyun
CPC: G06F9/5027
Verdict: High Notable software
First reported: 2026-W36 (2026-09-05)
Source: Google Patents · FreePatentsOnline

The keeper's note

Aligns a scripted performance plan to its live execution using multimodal cues — show-control for animatronic/robot performances.

Abstract

The present invention sets forth techniques for aligning a performance plan to an execution of a scripted performance. The techniques include receiving a performance plan, wherein the performance plan includes one or more documents associated with a scripted performance, and identifying, via a first machine learning model and based on the one or more documents, one or more segments included in the scripted performance. The techniques also include predicting, via a second machine learning model, a current segment of the one or more segments based at least on one or more observation signals associated with an execution of the scripted performance, and initiating the execution of one or more automated actions based on the predicted current segment.

Background

BACKGROUND Field of the Various Embodiments

Embodiments of the present disclosure relate generally to script-based performance monitoring and, more specifically, to techniques for aligning a plan to an execution using multimodal cues for script-based performance monitoring. Description of the Related Art

Scripted performances may include, but are not limited to, live shows, presentations, film shoots, parades, or meet-and-greet events between performers and members of the public. Some performances may be intended to closely follow an associated script in a linear fashion, while other performances may incorporate nonlinear execution, such as branches or loops in the script.

It may be desirable to track or otherwise monitor the execution of a performance based on a script or other plan associated with the performance. In some instances, monitoring the performance may allow for a post-performance evaluation of how faithfully the performance adhered to the script or other plan. Monitoring a state of a performance relative to the script or other plan may also aid in manually or automatically responding to cues included in the script or other plan, such as initiating sound effects, visual effects, lighting effects, or execution of animatronic or other robotic actions.

Existing methods of scripted performance monitoring may be configured for a specific performance, and may require direct human intervention to compare a state of a performance to a predicte

Claims

1. A computer-implemented method for aligning a performance plan to an execution of a scripted performance, the computer-implemented method comprising: receiving a performance plan, wherein the performance plan includes one or more documents associated with a scripted performance; identifying, via a first machine learning model and based on the one or more documents, one or more segments included in the scripted performance; predicting, via a second machine learning model, a current segment of the one or more segments based at least on one or more observation signals associated with the execution of the scripted performance; and initiating an execution of one or more automated actions based on the predicted current segment. || 10. One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of: receiving a performance plan, wherein the performance plan includes one or more documents associated with a scripted performance; identifying, via a first machine learning model and based on the one or more documents, one or more segments included in the scripted performance; predicting, via a second machine learning model, a current segment of the one or more segments based at least on one or more observation signals associated with the execution of the scripted performance; and initiating an execution of one or more automated actions based on the predicted current segment. || 19. A system comprising: one or more memories storing instructions; and one or more processors for executing the instructions to: receive a performance plan, wherein the performance plan includes one or more documents associated with a scripted performance; identify, via a first machine learning model and based on the one or more documents, one or more segments included in the scripted performance; predict, via a second machine learning model, a current segment of the one or more segments based at least on one or more observation signals associated with the execution of the scripted performance; and initiate an execution of one or more automated actions based on the predicted current segment.