Coordinated gesture and locomotion for virtual pedestrians

Number: 9811937
Published: 2017-11-07
Filed: 2015-09-29
Assignee: Disney Enterprises, Inc.
Inventors: OSullivan; Carol A., Ruhland; Kerstin, Neff; Michael, Wang; Yingying
CPC: G11B27/00; G06T13/40
Verdict: Low Notable software
Source: Google Patents · FreePatentsOnline

The keeper's note

Renders realistic conversational gestures for virtual pedestrians by learning motion data models from captured human gesture video.

Abstract

Techniques for rendering realistic depictions ofconversational gestures are provided. Embodiments include generating a data model for a first conversational gesture type, by analyzing captured video data to determine motion attribute data for a plurality of conversational gestures. Additionally, upon receiving a request to splice a gesture of the first conversational gesture type into a first animation, embodiments determine a locomotion of a first virtual character, while the first virtual character is interacting with a second virtual character within the first animation. A gesture of the first conversational gesture type is then stylized, using the generated data model and based on the determined locomotion of the first virtual character within the animation. Embodiments splice the stylized gesture into the locomotion of the first virtual character within the received animation data.

Background

BRIEF DESCRIPTION OF THE DRAWINGS(1) So that the manner in which the above recited aspects are attained and can be understood in detail, a more particular description of embodiments of the invention, briefly summarized above, may be had by reference to the appended drawings.(2) It is to be noted, however, that the appended drawings illustrate only typical embodiments of this invention and are therefore not to be considered limiting of its scope, for the invention may admit to other equally effective embodiments.(3) FIG. 1 is a block diagram illustrating a systemconfigured with a conversational gesture component, according to one embodiment describedherein.(4) FIGS. 2A-C illustrate rendered images with different preexisting movements into which a conversational gesture was spliced, according to embodiments described herein.(5) FIG. 3 illustrates a frame rendered from a three-dimensional scene containing multiple virtual characters engaged in group conversation, according to one embodiment described herein.(6) FIG. 4 is a block diagram illustrating a method of splicing a gesture into an existing locomotive activity performed by a virtual character, according to one embodiment described herein.(7) FIG. 5 is a block diagram illustrating a method for stylistically splicing a modified gesture into an existing locomotive activity performed by a virtual character, according to one embodiment described herein.(8) FIG. 6 is a block diagram illustratinga system configured with a conv

Claims

1. A method, comprising: generating a data model for a first conversational gesture type, by analyzing captured video data to determine motion attribute data for a plurality of conversational gestures; upon receivinga request to splice a gesture of the first conversational gesture type into a first animation, determining a locomotion of a first virtual character, while the first virtual character is interacting with a second virtual character within the first animation; stylizing,by operation of one or more computer processors, a gesture of the first conversational gesture type to match style criteria associated with the locomotion of the first virtual character based on the motion attribute data of the generated data model for the first conversational gesture type; and splicing the stylized gesture into the locomotion of the first virtual character within the first animation. 13. A non-transitory computer-readable medium containing computer program code that, when executed, performs an operation, comprising:generating a data model for a first conversational gesture type, by analyzing captured video data to determine motion attribute data for a plurality of conversational gestures; upon receiving a request to splice a gesture of the first conversational gesture type into afirst animation, determining a locomotion of a first virtual character, while the first virtual character is interacting with a second virtual character within the first animation; stylizing a gesture of the first conversational gesture type to match style criteria associated with the locomotion of the first virtual character based on the motion attribute data of the generated data model for the first conversational gesture type; and splicing the stylized gesture into the locomotion of the first virtual character within the first animation. 20. A system, comprising: one or more computer processors; and a memory containingcomputer program code that, when executed by operation of the one or more computer processors, performs an operation comprising: generating a data model for a first conversationalgesture type, by analyzing captured video data to determine motion attribute data for a plurality of conversational gestures; upon receiving a request to splice a gesture of the first conversational gesture type into a first animation, determining a locomotion of a first virtual character, while the first virtual character is interacting with a second virtual character within the first animation; stylizing a gesture of the first conversational gesture type to match style criteria associated with the locomotion of the first virtual character based on the motion attribute data of the generated data model for the first conversational gesture type; and splicing the stylized gesture into the locomotion of the firstvirtual character within the first animation.