Mobile tele-immersive AR/VR gameplay.
Techniques for displaying an augmented reality environment. Embodiments capture a visual scene for display. An embedded symbol associated with a garment worn by the first user within the visual scene is identified. Embodiments generate a virtual augmentation corresponding to the first user that is animated based on the captured visual scene. The virtual augmentation alters an appearance of the first user, such that the first user is depicted as wearing a virtual costume, the virtual costume determined to have a predefined relationship with the identified embedded symbol. A sequence of frames is rendered that depicts the first user augmented with the virtual augmentation in the augmented reality environment and depict at least a portion of the first user as wearing the virtual costume.
BACKGROUND(1) Field of the Invention(2) The present invention generally relates to a human-computer interface and more specifically to techniques for providing a multiuser augmented reality world on an augmented reality device.(3) Description of the Related Art(4) Computer graphics technology has come a long way since video games were first developed. Relatively inexpensive 3D graphics engines now provide nearly photo-realistic interactive game play on hand-held video game, home video game and personal computer hardware platforms costing only a few hundred dollars. These video game systems typically include a hand-held controller, game controller, or, in the case of a hand-held video game platform, an integrated controller. A user or player uses the controller to send commands or other instructions to the video game system to control a video game or other simulation being played. For example, the controller may be provided with a manipulator (e.g., a joystick) and buttons operated by the user.(5) Many hand-held gaming devices include some form of camera device which may be used to capture an image or a series of images of a physical, real-world scene. The captured images can then be displayed, for instance, on a display of the hand-held gaming device. Certain devices may be configured to insert virtual objects into the captured images before the images are displayed. Additionally, other devices or applications may enable users to draw or paint particular within a captured ima
1. A method of displaying an augmented reality environment, comprising: capturing a visual scene for display using one or more camera devices; identifying, in the visual scene, an embedded symbol associated with a garment worn by a first user; determining a virtual costume having a predefined relationship with the identified embedded symbol; generating a virtual augmentation corresponding to the first user that is animated based on the captured visual scene; rendering a sequence of frames depicting an appearance of the first user as altered by the virtual augmentation in the augmented reality environment, wherein the rendered sequence of frames depict the first user wearing the virtual costume; generating augmented audio data by applying an audio effect to user speech data for the first user captured using one or more microphone devices, wherein the audio effect has a predefined relationship with the virtual costume; and outputting the augmented audio data for playback, together with the rendered sequence of frames.
9. A computer-readable storage memory containing a program that, when executed by a processor, performs an operation for displaying a multiuser augmented reality environment, comprising: capturing a visual scene for display using one or more camera devices; identifying, in the visual scene, an embedded symbol associated with a garment worn by a first user; determining a virtual costume having a predefined relationship with the identified embedded symbol; generating a virtual augmentation corresponding to the first user that is animated based on the captured visual scene; rendering a sequence of frames depicting an appearance of the first user as altered by the virtual augmentation in the augmented reality environment, wherein the rendered sequence of frames depict the first user wearing the virtual costume; generating augmented audio data by applying an audio effect to user speech data for the first user captured using one or more microphone devices, wherein the audio effect has a predefined relationship with the virtual costume; and outputting the augmented audio data for playback, together with the rendered sequence of frames.
17. An augmented reality device, comprising: a processor; and a memory containing a program that, when executed on the processor, performs an operation for displaying a multiuser augmented reality environment, comprising: capturing a visual scene for display using one or more camera devices; identifying, in the visual scene, an embedded symbol associated with a garment worn by a first user; determining a virtual costume having a predefined relationship with the identified embedded symbol; generating a virtual augmentation corresponding to the first user that is animated based on the captured visual scene; rendering a sequence of frames depicting an appearance of the first user as altered by the virtual augmentation in the augmented reality environment, wherein the rendered sequence of frames depict the first user wearing the virtual costume; generating augmented audio data by applying an audio effect to user speech data for the first user captured using one or more microphone devices, wherein the audio effect has a predefined relationship with the virtual costume; and outputting the augmented audio data for playback, together with the rendered sequence of frames.