- Number
- 20170148201
- Published
- 2017-05-25
- Filed
- 2017-02-03
- Assignee
- Lucasfilm Entertainment Company Ltd.
- Inventors
- Bhat; Kiran, Koperwas; Michael, Yost; Jeffery, Yu; Ji Hun, Santos; Sheila
- CPC
- G06V40/176; G06T13/40; G06F18/22; G06T7/60; G06T13/80; G06T7/75
- Verdict
- Medium Notable software
- Source
- Google Patents · FreePatentsOnline
The keeper's note
A performance capture system that determines animation model control values from a captured subjects performance, reproducing the performance on an animated character.
Abstract
Performance capture systems and techniques are provided for capturing a performance of a subject and reproducing an animated performance that tracks the subject's performance. A method may include obtaining input data corresponding to a pose performed by the subject, the input data including position information defining positions on a face of the subject. The method may further include obtaining an animation model for the subject that includes adjustable controls that control the animation model to define facial features of the computer-generated representation of the face, and matching one or more of the positions on the face with one or more corresponding positions on the animation model.
Background
Relates to capturing performance characteristics of a subject for animation. Providing a realistic animation of a subject or fictional character requires that the subject's performance is effectively captured so nuances are conveyed in the animation. Transfer of the performance onto a computer-generated representation can be complex and difficult. Uses input data from video images of the subject performing poses; a solver determines values for adjustable controls of an animation model for the subject.
Claims
**1.** A computer-implemented method comprising: obtaining input data corresponding to a pose of a subject, the input data including position information for points on a face of the subject; obtaining an animation model, the animation model being associated with adjustable controls usable for adjusting the animation model to define poses for a computer representation of a face; determining, using the position information, a correspondence between one or more of the points on the face of the subject and one or more points of the computer representation of the face, wherein the determining includes using an objective function to project an error onto a control space of the animation model; and setting the one or more adjustable controls to have one or more values based on the projected error and one or more constraints for the one or more adjustable controls, wherein the setting of the one or more adjustable controls causes the computer representation of the face to have a pose based on the pose of the subject.
**15.** A system, comprising: a memory storing a plurality of instructions; and one or more processors configurable to: obtain input data corresponding to a pose of a subject, the input data including position information for points on a face of the subject; obtain an animation model, the animation model being associated with adjustable controls usable for adjusting the animation model to define poses for a computer representation of a face; determine, using the position information, a correspondence between one or more of the points on the face of the subject and one or more points of the computer representation of the face, wherein the determining includes using an objective function to project an error onto a control space of the animation model; and set the one or more adjustable controls to have one or more values based on the projected error and one or more constraints for the one or more adjustable controls, wherein the setting of the one or more adjustable controls causes the computer representation of the face to have a pose based on the pose of the subject.
**18.** A computer-readable memory storing a plurality of instructions executable by one or more processors, the plurality of instructions comprising: instructions that cause the one or more processors to obtain input data corresponding to a pose of a subject, the input data including position information for points on a face of the subject; instructions that cause the one or more processors to obtain an animation model, the animation model being associated with adjustable controls usable for adjusting the animation model to define poses for a computer representation of a face; instructions that cause the one or more processors to determine, using the position information, a correspondence between one or more of the points on the face of the subject and one or more points of the computer representation of the face, wherein the determining includes using an objective function to project an error onto a control space of the animation model; and instructions that cause the one or more processors to set the one or more adjustable controls to have one or more values based on the projected error and one or more constraints for the one or more adjustable controls, wherein the setting of the one or more adjustable controls causes the computer representation of the face to have a pose based on the pose of the subject.