- Number
- 12762775
- Published
- 2026-10-13
- Filed
- 2021-06-10
- Assignee
- Disney Enterprises, Inc.
- Inventors
- Wood; Andrew E., Navarre; Katharine S., Binder; Evan A., Perlman; Drew E.
- CPC
- G06T13/40
- Verdict
- Low Notable software
- First reported
- 2026-W42 (2026-10-16)
- Source
- Google Patents · FreePatentsOnline
The keeper's note
Records a performer's body and facial motion, then grafts in motion-capture data from a second performance to splice two actors' takes into one animated character.
Abstract
Embodiments provide for improved capture and modification of sensor data. A first performance in a physical environment is recorded, and a first data object is generated, comprising at least a first motion capture element from the first performance, where the first motion capture element includes at least one of (i) body data or (ii) facial data. A request to modify the first data object based on a second data object including motion capture data from a second performance is received, and the first data object is modified by adding, to the first data object, a second motion capture element from the second data object. The modified first data object including the first motion capture element and the second motion capture element is outputted.
Background
BACKGROUND (1) The present disclosure generally relates to motion capture, and more specifically, to improved techniques for capturing and manipulating motion capture data. (2) In animation production (including three-dimensional computer generated animations) for television, games, streaming media, and movies, various software is utilized in an animation pipeline beginning with concept and ending with a final animated product. Typically these systems utilize discrete pre-production and post-production elements, and lack significant interactivity between each step. For example, an artist may provide a storyboard or other notes to an animator to create an animation. Once the animation is completed, the original artist can suggest modifications or changes to preserve the original intent. Existing systems do not allow for efficient communication of these intents at the outset, which can introduce tremendous delay and waste. Existing systems are similarly unable to provide useful interactivity of the process, resulting in similar delay and wasted expense. SUMMARY (3) Embodiments disclosed herein provide for improved collection and manipulation of motion capture data. A first performance in a physical environment is recorded, and a first data object is generated comprising at least a first motion capture element from the first performance, where the first motion capture element includes at least one of (i) body data or (ii) facial data. A request to modify the first data object ba
Claims
1. A method, comprising: configuring a recording aspect of a first take object through a selection of a first sensor data type and a second sensor data type within a take object region of a user interface, wherein the first sensor data type is different from the second sensor data type, and wherein the first take object is a unified and parameterized data object configured to combine and synchronize first data of the first sensor data type with second data of the second sensor data type; initiating, through selection of a graphic element of the user interface and for a first performance in a physical environment, simultaneous capture of first sensor data from a first sensor and second sensor data from a second sensor based on the selection of the first and second sensor data types, respectively; responsive to the selection of the graphic element, transitioning the user interface to an armed state for locking one or more recording attributes used for recording the first and second sensor data to generate combined captured sensor data including facial movement capture data from the first sensor and body movement capture data from the second sensor, wherein the one or more recording attributes include at least one of (a) a character for which the combined recorded data should be used, (b) a recording path defining where the combined recorded data will be stored, (c) a display name for the first take object, (d) an audio selection for the first take object, (e) an indication to output the audio selection in the physical environment during recording of the first and second sensor data, and (f) an indication that the first and second sensor data will be recorded for the first take object; synchronizing the captured first sensor data with the captured second data to generate synchronized data that aligns a first data stream of the captured first sensor data with a second data stream of the captured second sensor data; storing the synchronized data as the first take object including at least one first motion capture element from the first performance; displaying an indication of the first take object on a timeline; generating an animatic based on the first take object; and generating an animation based on (a) the animatic, and (b) a modified take object created (i) by adding a second motion capture element from a second performance included in a second take object different from the first take object, or (ii) by replacing the first motion capture element with the second motion capture element. ||
11. A non-transitory computer-readable medium containing computer program code that, when executed by operation of one or more computer processors, performs an operation comprising: configuring a recording aspect of a first take object through a selection of a first sensor data type and a second sensor data type within a take object region of a user interface, wherein the first sensor data type is different from the second sensor data type, and wherein the first take object is a unified and parameterized data object configured to combine and synchronize first data of the first sensor data type with second data of the second sensor data type; initiating, through selection of a graphic element of the user interface and for a first performance in a physical environment, simultaneous capture of first sensor data from a first sensor and second sensor data from a second sensor based on the selection of the first and second sensor data types, respectively: responsive to the selection of the graphic element, transitioning the user interface to an armed state for locking one or more recording attributes used for recording the first and second sensor data to generate combined captured sensor data including facial movement capture data and from the first sensor and body movement capture data from the second sensor, wherein the one or more recording attributes include at least one of (a) a character for which the combined recorded data should be used, (b) a recording path defining where the combined recorded data will be stored, (c) a display name for the first take object, (d) an audio selection for the first take object, (e) an indication to output the audio selection in the physical environment during recording of the first and second sensor data, and (f) an indication that the first and second sensor data will be recorded for the first take object; synchronizing the captured first sensor data with the captured second data to generate synchronized data that aligns a first data stream of the captured first sensor data with a second data stream of the captured second sensor data: storing the synchronized data as the first take object including at least one first motion capture element from the first performance; displaying an indication of the first take object on a timeline; generating an animatic based on the first take object; and generating an animation based on (a) the animatic, and (b) a modified take object created (i) by adding a second motion capture element from a second performance included in a second take object different from the first take object, or (ii) by replacing the first motion capture element with the second motion capture element. ||
17. A system comprising: one or more computer processors; and a memory containing a program which, when executed by the one or more computer processors, performs an operation, the operation comprising: configuring a recording aspect of a first take object through a selection of a first sensor data type and a second sensor data type within a take object region of a user interface, wherein the first sensor data type is different from the second sensor data type, and wherein the first take object is a unified and parameterized data object configured to combine and synchronize first data of the first sensor data type with second data of the second sensor data type; initiating, through selection of a graphic element of the user interface and for a first performance in a physical environment, simultaneous capture of first sensor data from a first sensor and second sensor data from a second sensor based on the selection of the first and second sensor data types, respectively; responsive to the selection of the graphic element, transitioning the user interface to an armed state for locking one or more recording attributes used for recording the first and second sensor data to generate combined captured sensor data including facial movement capture data from the first sensor and body movement capture data from the second sensor, wherein the one or more recording attributes include at least one of (a) a character for which the combined recorded data should be used, (b) a recording path defining where the combined recorded data will be stored, (c) a display name for the first take object, (d) an audio selection for the first take object, (e) an indication to output the audio selection in the physical environment during recording of the first and second sensor data, and (f) an indication that the first and second sensor data will be recorded for the first take object; synchronizing the captured first sensor data with the captured second data to generate synchronized data that aligns a first data stream of the captured first sensor data with a second data stream of the captured second sensor data; storing the synchronized data as the first take object including at least one first motion capture element from the first performance; displaying an indication of the first take object on a timeline; generating an animatic based on the first take object; and generating an animation based on (a) the animatic, and (b) a modified take object created (i) by adding a second motion capture element from a second performance included in a second take object different from the first take object, or (ii) by replacing the first motion capture element with the second motion capture element.