Outer Rim Archives
Archives · 2017 · 9588730

Granted patent

Mobile tele-immersive gameplay

Number
9588730
Published
2017-03-07
Filed
2013-01-11
Assignee
Disney Enterprises, Inc.
Inventors
Mitchell; Kenneth
CPC
A63F13/35; G06F3/017; G06F3/011; A63F13/213; G06T19/006; G06F3/147
Verdict
Medium Hardware
Source
Google Patents · FreePatentsOnline

The keeper's note

Mobile tele-immersive gameplay hardware/interaction system using gesture sensing.

Abstract

Techniques for displaying a multiuser augmented reality world on a first augmented reality device. Embodiments capture a visual scene for display. The visual scene includes afirst user and wherein the visual scene is captured using one or more camera devices. Visual scene data for a second user is received from a second augmented reality device. Embodiments rendering a sequence of frames for display which depict the first user and the second user in an augmented reality world, where the depiction of the first user is based on the captured visual scene, and where the depiction of the second user is based on the received visual scene data.

Background

BRIEF DESCRIPTION OF THE DRAWINGS(1) So that the manner in which the above recited aspects are attained and can be understoodin detail, a more particular description of embodiments of the invention, briefly summarized above, may be had by reference to the appended drawings.(2) It is to be noted, however, that the appended drawings illustrate only typical embodiments of this invention and aretherefore not to be considered limiting of its scope, for the invention may admit to other equally effective embodiments.(3) FIG. 1 is a block diagram illustrating an augmented reality device configured with a multi-user augmented reality component, according to one embodiment described herein.(4) FIG. 2 illustrates users interacting with an augmented reality device, according to one embodiment described herein.(5) FIG. 3 is a screenshot of a display of the augmented reality device shown in FIG. 2, according to one embodiment described herein.(6) FIG. 4 illustrates a user interacting with an augmented reality device configured with a multi-user augmented reality component, according to one embodiment describedherein.(7) FIG. 5 is a screenshot of an alternate display for the augmented reality device shown in FIG. 4, according to one embodiment described herein.(8) FIG. 6 is a flow diagram illustrating a method for displaying an augmented reality world on an augmented realitydevice, according to one embodiment described herein.(9) FIG. 7 is a flow diagram illustrating a method for displa

Claims

1. A method of displaying a multiuser augmented reality environment, comprising: capturing a visual scene for display, wherein the visual scene includes a first user and wherein the visual scene is captured in a first location using a first plurality of camera devices; identifying, in the visual scene, an embedded symbol associated with a garment worn by the first user; generating a virtual augmentation corresponding to the first user that is animated based on the captured visual scene, wherein the virtual augmentation comprises: selecting a costume, from a plurality of different distinct costumes, without requiring user interaction by the first user; the selected costume having a predefined relationship with the identified embedded symbol; and determining a manner in which to alter an appearance of the first user, such that the first user is depicted aswearing the selected costume; receiving, over a data communications network, visual scenedata for a second user, wherein the received visual scene data is captured in a second location, distinct from the first location, using a second plurality of camera devices; transmitting, over the data communications network, data representative of a three-dimensionalrepresentation of the first user, based on images captured using the first plurality of camera devices, wherein a remote augmented reality device in the second location is configured to rendering a sequence of frames for display depicting, at least in part, a first augmented reality character corresponding to the first user in the multiuser augmented reality environment; generating an augmented reality character corresponding to the second user,wherein the augmented reality character is animated based on the received visual scene data; and rendering a sequence of frames for display, wherein the sequence of frames depictsthe first user augmented with the virtual augmentation and the augmented reality character corresponding to the second user in the multiuser augmented reality environment, whereinthe rendered sequence of frames depict at least a portion of the first user as wearing the selected costume. 9. A computer-readable storage memory containing a program that, when executed by a processor, performs an operation for displaying a multiuser augmented reality environment, comprising: capturing a visual scene for display, wherein the visual scene includes a first user and wherein the visual scene is captured in a first location using afirst plurality of camera devices; identifying, in the visual scene, an embedded symbol associated with a garment worn by the first user; generating a virtual augmentation corresponding to the first user that is animated based on the captured visual scene, wherein the virtual augmentation comprises: selecting a costume, from a plurality of different distinct costumes, without requiring user interaction by the first user; the selected costume having a predefined relationship with the identified embedded symbol; and determining a manner in which to alter an appearance of the first user, such that the first user is depicted as wearing the selected costume; receiving, over a data communications network, visual scene data for a second user, wherein the received visual scene data is captured in a second location, distinct from the first location, using a second plurality of camera devices; transmitting, over the data communications network, data representative of a three-dimensional representation of the first user, based on images captured using the first plurality ofcamera devices, wherein a remote augmented reality device in the second location is configured to rendering a sequence of frames for display depicting, at least in part, a first augmented reality character corresponding to the first user in the multiuser augmented reality environment; generating an augmented reality character corresponding to the second user, wherein the augmented reality character is animated based on the received visual scene data; and rendering a sequence of frames for display, wherein the sequence of frames depicts the first user augmented with the virtual augmentation and the augmented reality character corresponding to the second user in the multiuser augmented reality environment, wherein the rendered sequence of frames depict at least a portion of the first user as wearing the selected costume. 17. An augmented reality device, comprising: a processor; and a memory containing a program that, when executed on the processor, performs an operation for displaying a multiuser augmented reality environment, comprising: capturing a visual scene for display, wherein the visual scene includes a first user and wherein the visual scene iscaptured in a first location using a first plurality of camera devices; identifying, in the visual scene, an embedded symbol associated with a garment worn by the first user; generating a virtual augmentation corresponding to the first user that is animated based on the captured visual scene, wherein the virtual augmentation comprises: selecting a costume, from a plurality of different distinct costumes, without requiring user interaction by thefirst user; the selected costume having a predefined relationship with the identified embedded symbol; and determining a manner in which to alter an appearance of the first user, such that the first user is depicted as wearing the selected costume; receiving, over a data communications network, visual scene data for a second user, wherein the received visual scene data is captured in a second location, distinct from the first location, using a second plurality of camera devices; transmitting, over the data communications network, data representative of a three-dimensional representation of the first user, based on images captured using the first plurality of camera devices, wherein a remote augmented reality device in the second location is configured to rendering a sequence of frames for display depicting, at least in part, a first augmented reality character corresponding to the firstuser in the multiuser augmented reality environment; generating an augmented reality character corresponding to the second user, wherein the augmented reality character is animated based on the received visual scene data; and rendering a sequence of frames for display,wherein the sequence of frames depicts the first user augmented with the virtual augmentation and the augmented reality character corresponding to the second user in the multiuseraugmented reality environment, wherein the rendered sequence of frames depict at least a portion of the first user as wearing the selected costume. 26. A method for displaying a user in an augmented reality environment, comprising: capturing a visual scene for display,wherein the visual scene includes a first user and wherein the visual scene is captured using a plurality of camera devices; analyzing the captured visual scene to detect an embedded symbol on an article worn by the first user; receiving, over a data communications network, visual scene data for a second user, wherein the received visual scene data is captured in a second location, distinct from the first location, using a second plurality of camera devices; transmitting, over the data communications network, data representative of athree-dimensional representation of the first user, based on images captured using the first plurality of camera devices, wherein a remote augmented reality device in the second location is configured to rendering a sequence of frames for display depicting, at least inpart, a first augmented reality character corresponding to the first user in the augmented reality environment; generating an augmented reality character corresponding to the second user, wherein the augmented reality character is animated based on the received visual scene data; determining one or more augmentations to apply to the first user in the captured visual scene, based on determining that the embedded symbol has a predefined relationship with a respective one of a plurality of appearance augmentations, comprising: selectinga costume from a plurality of distinct costumes, without requiring user interaction, based on a signal received from a device associated with the first user, a user profile corresponding to the first user, and a determination that the embedded symbol has a predefined relationship with the respective one of a plurality of appearance augmentations; and rendering a sequence of frames for display, wherein the sequence of frames depict the first userand the augmented reality character corresponding to the second user in the augmented reality environment, wherein the depiction of the first user is altered based on the determined one or more augmentations, such that the first user is depicted within the sequence of frames as wearing the selected costume.