Outer Rim Archives
Archives · 2024 · 20240391094

Application (pre-grant publication)

VERSATILE MOTION PRIORS FOR ARTIST-DIRECTABLE PHYSICAL CHARACTERS

Number
20240391094
Published
2024-11-28
Filed
2024-05-10
Assignee
DISNEY ENTERPRISES, INC.
Inventors
Bächer; Moritz Niklaus et al.
CPC
B25J9/161; B25J9/1664; B25J9/163
Verdict
High Hardware
Source
Google Patents · FreePatentsOnline

The keeper's note

Motion-priors control technique for artist-directable physical/robotic characters (Bächer).

Abstract

An encoder is trained to generate latent representations of kinematic motion from motion data and a control policy is trained to generate dynamics informed output for a robotic system based on the latent representations of kinematic motion. The encoder and the control policy are deployed in the robotic system to generate the dynamics informed output based on the motion data.

Background

FIELD

The present application relates to systems and methods of generating physics-based or robotic characters based on artist input. BACKGROUND

Conventional animation techniques may be difficult to apply to robotics, as animated characters do not always follow the laws of physics. Physical robots, in contrast, must observe the laws of physics to remain dynamically stable. However, it is often desirable (e.g., where autonomous robots are provided for specific characters) to utilize animation techniques to imitate the style of a particular character, such as the gait and movement characteristics of the character while performing tasks such as everyday tasks, athletic motions, and/or other types of movements. Existing physics-based character tools generally provide for only indirect control of a character, making integration with traditional animation tools difficult. Further, such tools often use motion capture data as input. Generally, motion capture data is not sufficient for autonomous character control, as motion sequences provide only predefined responses and do not allow characters to respond to uncertain conditions. Additionally, there may be a need to update animation or provide different robotic devices different animation or movement skills and conventional techniques are time intensive requiring much iteration and training before deployment. BRIEF SUMMARY

A computer implemented method includes training an encoder to generate latent representatio

Claims

1. A computer implemented method comprising: training an encoder to generate latent representations of kinematic motion from motion data; training a control policy to generate dynamics informed output for a robotic system based on the latent representations of kinematic motion; and deploying the encoder and the control policy in the robotic system to generate the dynamics informed output based on the motion data. || 8. One or more non-transitory computer readable media encoded with instructions which, when executed by one or more processors, cause the one or more processors to: receive artist-specified kinematic input; generate a latent representation of the artist-specified kinematic input using an encoder; and generate dynamics informed output for a robotic system based on the latent representation and using a control policy. || 15. A character control system comprising: an encoder configured to generate latent representations of kinematic motion from motion data; and a control policy configured to generate dynamics informed output for a robotic system based on the latent representations and a current state of a character.