- Number
- 11508127
- Published
- 2022-11-22
- Filed
- 2018-11-13
- Assignee
- Disney Enterprises, Inc.
- Inventors
- Goslin; Michael P., Nocon; Nathan D., Hsu; Jonathan R D, Haseltine; Eric C., Baumbach; Elliott H.
- CPC
- G06T19/006; G02B27/0172; G02B27/017
- Verdict
- Low Hardware
- Source
- Google Patents · FreePatentsOnline
The keeper's note
AR-capture hardware for head-mounted displays.
Abstract
To capture augmented reality (AR) on a head mounted display the embodiments described herein include the optical display of virtual components of an AR on an AR device. A real world view within a field of view of the display of the AR device is captured, creating a composite image that combines the virtual components and real world physical components within the field of view of the AR device.
Background
BACKGROUND Field of the Invention (1) This present disclosure relates to the optical display of an Augmented Reality (AR) System for capturing, recording and/or rendering an augmented reality experience of a user, including both virtual and real world components. Description of the Related Art (2) Computer graphics technology has significantly progressed since the first video games were developed. Relatively inexpensive 3D graphics engines now provide nearly photo-realistic interactive gameplay on hand-held video game systems, home video game systems, and personal computer hardware platforms costing only a few hundred dollars. This interactive gameplay has also migrated to the virtual or augmented reality realms where the gameplay can incorporate virtual components of a game into a real world setting using specialized head mounted displays. (3) With the increased quality of gameplay, there has also been an increased interest in viewing others gameplay resulting in large scale streaming and video platforms dedicated to the viewing of live and recorded gameplay of both personal gameplay and gameplay of professional game players. While there are methods for streaming and recording augmented reality gameplay, the current methods fail to realistically capture what a game player is seeing and experiencing in an AR headset since the methods rely on external capture of the player's experience. This results in streaming of static scenes that seem more like a virtual reality setting to
Claims
1. A method, comprising: capturing, using a visual sensor fixed within an augmented reality (AR) device and facing a display of the AR device, an AR environment image, wherein the AR environment image comprises at least one virtual component and a user environment background, wherein the at least one virtual component and the user environment background are simultaneously captured by the visual sensor, wherein the user environment background is a real world view within a field of view of the display, wherein the visual sensor is positioned within the AR device and between a center of a line of sight of an eye of a user of the AR device and the display of the AR device, wherein the visual sensor is positioned in the AR device to match a position of the eye of the user to prevent offset correction image processing prior to external transmission, wherein the AR environment image comprises a field of view of the display as viewed by the eye of the user within the AR device, wherein a light associated with the user environment background and captured by the visual sensor passes directly through the display of the AR device to the visual sensor, and wherein the at least one virtual component is reflected on the display of the AR device; and processing the AR environment image for external transmission. ||
9. A computer-readable storage medium comprising computer-readable program code embodied therewith, the computer-readable program code is configured to perform, when executed by a processor, an operation, the operation comprising: capturing, using a visual sensor fixed within an augmented reality (AR) device and facing a display of the AR device, an AR environment image, wherein the AR environment image comprises at least one virtual component and a user environment background, wherein the at least one virtual component and the user environment background are simultaneously captured by the visual sensor, wherein the user environment background is a real world view within a field of view of the display, wherein the visual sensor is positioned within the AR device and between a center of a line of sight of an eye of a user of the AR device and the display of the AR device, wherein the visual sensor is positioned in the AR device to match a position of the eye of the user to prevent offset correction image processing prior to external transmission, wherein the AR environment image comprises a field of view of the display as viewed by the eye of the user within the AR device, wherein a light associated with the user environment background and captured by the visual sensor passes directly through the display of the AR device to the visual sensor, and wherein the at least one virtual component is reflected on the display of the AR device; and processing the AR environment image for external transmission. ||
15. A system, comprising: a processor; and a memory comprising instructions which, when executed on the processor, performs an operation, the operation comprising: capturing, using a visual sensor fixed within an augmented reality (AR) device and facing a display of the AR device, an AR environment image, wherein the AR environment image comprises at least one virtual component and a user environment background, wherein the at least one virtual component and the user environment background are simultaneously captured by the visual sensor, wherein the user environment background is a real world view within a field of view of the display, wherein the visual sensor is positioned within the AR device and between a center of a line of sight of an eye of a user of the AR device and the display of the AR device, wherein the visual sensor is positioned in the AR device to match a position of the eye of the user to prevent offset correction image processing prior to external transmission, wherein the AR environment image comprises a field of view of the display as viewed by the eye of the user within the AR device, wherein a light associated with the user environment background and captured by the visual sensor passes directly through the display of the AR device to the visual sensor, and wherein the at least one virtual component is reflected on the display of the AR device; and processing the AR environment image for external transmission.