- Number
- 10282882
- Published
- 2019-05-07
- Filed
- 2017-07-25
- Assignee
- Disney Enterprises, Inc.
- Inventors
- Sumner; Robert, Mitchell; Kenneth J., Hostettler; Rafael C., Coros; Stelian
- CPC
- A63F13/25; A63F13/65; G06T19/006; A63F13/52; A63F13/213; A63F13/00; G06T13/20
- Verdict
- Medium Notable software
- Source
- Google Patents · FreePatentsOnline
The keeper's note
Augmented reality simulation continuum.
Abstract
Techniques for simulating interactions using an augmented reality device. A visual scene is captured using a camera device. The visual scene depicts of a first physical object within a physical environment. A dynamic interaction is simulated between the first physical object and one or more virtual objects and velocity of a first virtual object resulting from the simulated dynamic interaction is calculated. A predefined behavior for a virtual character to perform is selected in response to the dynamic interaction. The virtual character is distinct from the first virtual object, and the selection is based on the calculated velocity. A sequence of frames is rendered. The sequence of frames depicts the dynamic interaction between the first physical object and the virtual objects, and further depicts a representation of the virtual character performing the determined behavior. The sequence of frames is output for display using one or more display devices.
Background
BACKGROUNDField of the Invention(1) The present invention generally relates to a human-computer interface and more specifically to techniques for simulating dynamic interactions on an augmented reality device.Description of the Related Art(2) Computer graphics technology has come a long way since video games were first developed. Relatively inexpensive 3D graphics engines now provide nearly photo-realistic interactive game play on hand-held video game, home video game and personal computer hardware platforms costing only a few hundred dollars. These video game systems typically include a hand-held controller, game controller, or, in the case of a hand-held video game platform, an integrated controller. A user or player uses the controller to send commands or other instructions to the video game system to control a video game or other simulation being played. For example, the controller may be provided with a manipulator (e.g., a joystick) and buttons operated by the user.(3) Many hand-held gaming devices include some form of camera device which may be used to capture an image or a series of images of a physical, real-world scene. The captured images can then be displayed, for instance, on a display of the hand-held gaming device. In augmented reality devices, these captured images can be modified to include additional content, such as virtual objects. However, when the physical objects being photographed move over a series of frames, these physical objects may appear to inter
Claims
1. A computer-implemented method for simulating interactions using an augmented reality device, the computer-implemented comprising: capturing, using one or more camera devices, a visual scene that includes a depiction of a first physical object within a physical environment; rendering a first sequence of frames that depicts a virtual character interacting with at least one of the first physical object and one or more virtual objects, via a behavior of a first type; simulating, by operation of one or more computer processors of the augmented reality device, a dynamic interaction between the first physical object and the one or more virtual objects; calculating a velocity of a first one of the one or more virtual objects, resulting from the simulated dynamic interaction; determining, based on the velocity resulting from the simulated dynamic interaction, a behavior of a second type different than the first type, for the virtual character to perform; rendering a second sequence of frames that depicts the dynamic interaction between the first physical object and the one or more virtual objects and further depicts the virtual character performing the behavior of the second type; and outputting the first and second sequences of frames for display using one or more display devices.
12. An augmented reality device, comprising: one or more computer processors; and a memory containing a program that, when executed by the one or more computer processors, performs an operation for simulating interactions using an augmented reality device, the operation comprising: capturing a visual scene for display, wherein the visual scene is captured using one or more camera devices; rendering a first sequence of frames that depicts a virtual character interacting with at least one of a first physical object and one or more virtual objects, via a behavior of a first type; determining a surface, within a physical environment, on which the first physical object is positioned; retrieving a predefined profile corresponding to the surface, wherein the predefined profile described a plurality of attributes of the surface, wherein the plurality of attributes includes a friction coefficient for the surface; simulating a dynamic interaction between the first physical object and the one or more virtual objects, based, at least in part, on the plurality of attributes of the surface described in the predefined profile; rendering a second sequence of frames that depicts the simulated dynamic interaction the first physical object and the one or more virtual objects and further depicts the virtual character performing a behavior of a second type different than the first type, wherein the behavior of the second type is determined based on the simulated dynamic interaction; and outputting the first and second sequences of frames for display.
17. A non-transitory computer-readable medium containing a program that, when executed, performs an operation for simulating interactions using an augmented reality device, the operation comprising: capturing a visual scene for display, wherein the visual scene is captured using one or more camera devices; rendering a first sequence of frames that depicts a virtual character interacting with at least one of a first physical object and one or more virtual objects, via a behavior of a first type; determining a surface, within a physical environment, on which the first physical object is positioned; retrieving a predefined profile corresponding to the surface, wherein the predefined profile described a plurality of attributes of the surface; simulating a dynamic interaction between the first physical object and one or more virtual objects, based, at least in part, on the plurality of attributes of the surface described in the predefined profile, and by operation of one or more computer processors when executing the program; rendering a second sequence of frames that depicts the simulated dynamic interaction the first physical object and the one or more virtual objects and further depicts the virtual character performing a behavior of a second type different than the first type, wherein the behavior of the second type is determined based on the simulated dynamic interaction; and outputting the first and second sequences of frames for display.