- Number
- 9741145
- Published
- 2017-08-22
- Filed
- 2012-06-29
- Assignee
- Disney Enterprises, Inc.
- Inventors
- Mitchell; Kenny, Hostettler; Rafael C., Coros; Stelian, Sumner; Robert
- CPC
- G06T13/20; A63F13/00; A63F13/65; A63F13/25; A63F13/213; A63F13/52; G06T19/006
- Verdict
- Medium Notable software
- Source
- Google Patents · FreePatentsOnline
The keeper's note
An AR simulation continuum that simulates dynamic physics interactions between a real physical object seen by camera and virtual objects.
Abstract
Techniques for simulating interactions using an augmented reality device are described. Embodiments capture a visual scene for display, wherein the visual scene is capturedusing one or more camera devices. Embodiments simulate a dynamic interaction between the first physical object and one or more virtual objects. Additionally, a sequence of frames is rendered for display that depicts the simulated dynamic interaction the first physical object and the one or more virtual objects.
Background
BRIEF DESCRIPTION OF THE DRAWINGS(1) So that the manner in which the above recited aspects are attained and can be understood in detail, a more particular description of embodiments of the invention, briefly summarized above, may be had by reference to the appended drawings.(2) It is to be noted, however, that the appended drawings illustrate only typicalembodiments of this invention and are therefore not to be considered limiting of its scope, for the invention may admit to other equally effective embodiments.(3) FIG. 1 is a block diagram illustrating an augmented reality device configured with a dynamics simulation component, according to one embodiment described herein.(4) FIGS. 2A-B are diagrams illustrating augmented reality devices, according to embodiments described herein.(5) FIG. 3 is adiagram illustrating an augmented reality device, according to one embodiment described herein.(6) FIG. 4 is a flow diagram illustrating a method of simulating dynamics of interactions between virtual objects and physical objects on an augmented reality device, according to one embodiment described herein.(7) FIG. 5 is a block diagram illustrating an augmented reality device configured with a dynamics simulation component, according to one embodiment described herein.DETAILED DESCRIPTION(8) Embodiments described herein generally relate to techniques for displaying content on an augmented reality device. As used herein, anaugmented reality device refers to any device capable of displ
Claims
1. A method for simulating interactions using an augmented reality device, comprising: capturing a visual scene for display, wherein the visual scene includes a depiction of a first physical object within a physicalenvironment and wherein the visual scene is captured using one or more camera devices; simulating, by operation of one or more computer processors of the augmented reality device,a dynamic interaction between the first physical object and one or more virtual objects; calculating a velocity of a first one of the one or more virtual objects, resulting from the simulated dynamic interaction between the first physical object and the first virtual object; selecting one of a plurality of predefined behaviors for a virtual character to perform in response to the dynamic interaction, wherein the virtual character is distinct from the one or more virtual objects, and wherein the selection is based on a determination that the calculated velocity of the first virtual object exceeds a predefined threshold amount of velocity; rendering a sequence of frames for display that depict the dynamic interaction between the first physical object and the one or more virtual objects and further depict a representation of the virtual character performing the determined behavior; and transmitting an instruction to a control device, to cause the control device to activate an actuator associated with a first physical device in order to move the first physical objectat a specified speed and trajectory, wherein the speed and trajectory are dynamically determined based on the dynamic interaction between the physical object and the one or more virtual objects within the visual scene.
13. An augmented reality device, comprising: a processor; and a memory containing a program that, when executed by the processor, performs an operation for simulating interactions using an augmented reality device, comprising: capturing a visual scene for display, wherein the visual scene includes a depiction of a first physical object within a physical environment and wherein the visual scene is captured using one or more camera devices; simulating, by operation of one or more computer processors of the augmented reality device, a dynamic interaction between the first physical object and one or more virtual objects; calculating a velocity of a first one of the one or more virtual objects, resulting from the simulated dynamic interaction between the first physical object and the first virtual object; selecting one of a plurality of predefined behaviors for a virtual character to perform in response to the dynamic interaction, wherein the virtual character is distinct from the one or more virtual objects, and wherein the selection is based on a determination that the calculated velocity of the first virtual objectexceeds a predefined threshold amount of velocity; rendering a sequence of frames for display that depict the dynamic interaction between the first physical object and the one or more virtual objects and further depict a representation of the virtual character performing the determined behavior; and transmitting an instruction to a control device, to cause the control device to activate an actuator associated with a first physical device in order to move the first physical object at a specified speed and trajectory, wherein the speedand trajectory are dynamically determined based on the dynamic interaction between the physical object and the one or more virtual objects within the visual scene.
19. A non-transitory computer-readable medium containing a program that, when executed, performs an operation for simulating interactions using an augmented reality device, comprising: capturing a visual scene for display, wherein the visual scene includes a depiction of a first physical object within a physical environment and wherein the visual scene is captured using one or more camera devices; simulating, by operation of one or more computer processors of the augmented reality device, a dynamic interaction between the first physical object and one or more virtual objects; calculating a velocity of a first one of the one or more virtual objects, resulting from the simulated dynamic interaction between the first physical object and the first virtual object; selecting one of a plurality of predefined behaviors for a virtual character to perform in response to the dynamic interaction, wherein the virtual character is distinct from the one or more virtual objects, and wherein the selection is based on a determination that the calculated velocity of the first virtual object exceeds a predefined threshold amount of velocity; rendering a sequence of frames for display that depict the dynamic interaction between the first physical object and the one or more virtual objects and further depict a representation of the virtual character performing the determined behavior; and transmitting an instruction to a control device, to cause the control device to activate an actuator associated with a first physical device in order to move the first physical object at a specified speed and trajectory, wherein the speed and trajectory are dynamically determined based on the simulated dynamic interaction between thephysical object and the one or more virtual objects within the visual scene.