CAPTURING AUGMENTED REALITY ON A HEAD MOUNTED DISPLAY

Number: 20200151956
Published: 2020-05-14
Filed: 2018-11-13
Assignee: Disney Enterprises, Inc.
Inventors: GOSLIN; Michael P., NOCON; Nathan D., HSU; Jonathan RD, HASELTINE; Eric C., BAUMBACH; Elliott H.
CPC: G02B27/0172; G02B27/017; G06T19/006
Verdict: Medium Hardware
Source: Google Patents · FreePatentsOnline

The keeper's note

AR capture on wearable head-mounted display.

Abstract

To capture augmented reality (AR) on a head mounted display the embodiments described herein include the optical display of virtual components of an AR on an AR device. A real world view within a field of view of the display of the AR device is captured, creating a composite image that combines the virtual components and real world physical components within the field of view of the AR device.

Background

BACKGROUNDField of the Invention

This present disclosure relates to the optical display of an Augmented Reality (AR) System for capturing, recording and/or rendering an augmented reality experience of a user, including both virtual and real world components.Description of the Related Art

Computer graphics technology has significantly progressed since the first video games were developed. Relatively inexpensive 3D graphics engines now provide nearly photo-realistic interactive gameplay on hand-held video game systems, home video game systems, and personal computer hardware platforms costing only a few hundred dollars. This interactive gameplay has also migrated to the virtual or augmented reality realms where the gameplay can incorporate virtual components of a game into a real world setting using specialized head mounted displays.

With the increased quality of gameplay, there has also been an increased interest in viewing others gameplay resulting in large scale streaming and video platforms dedicated to the viewing of live and recorded gameplay of both personal gameplay and gameplay of professional game players. While there are methods for streaming and recording augmented reality gameplay, the current methods fail to realistically capture what a game player is seeing and experiencing in an AR headset since the methods rely on external capture of the player's experience. This results in streaming of static scenes that seem more like a virtual reality settin

Claims

1. A method, comprising: capturing, using a visual sensor fixed within an augmented reality (AR) device and facing a display of the AR device, a reflected AR environment image, wherein the AR environment image comprises at least one virtual component and a user environment background, wherein the user environment background is a real world view within a field of view of the display, and wherein the at least one virtual component and the user environment background are reflected on the display; and processing the AR environment image for external transmission. 9. A computer-readable storage medium comprising computer-readable program code embodied therewith, the computer-readable program code is configured to perform, when executed by a processor, an operation, the operation comprising: capturing, using a visual sensor fixed within an augmented reality (AR) device and facing a display of the AR device, a reflected AR environment image comprising at least one virtual component and a user environment background, wherein the user environment background is a real world view within a field of view of the display, and wherein the at least one virtual component and the user environment background are reflected on the display; and processing the AR environment image for external transmission. 15. A system, comprising: a processor; and a memory comprising instructions which, when executed on the processor, performs an operation, the operation comprising: capturing, using a visual sensor fixed within an augmented reality (AR) device and facing a display of the AR device, a reflected AR environment image comprising at least one virtual component and a user environment background, wherein the user environment background is a real world view within a field of view of the display, and wherein the at least one virtual component and the user environment background are reflected on the display; and processing the AR environment image for external transmission.