Outer Rim Archives
Archives · 2019 · 10424295

Granted patent

Calibration of virtual image displays

Number
10424295
Published
2019-09-24
Filed
2016-12-22
Assignee
Disney Enterprises, Inc.
Inventors
Haseltine; Eric C., Goslin; Michael P., Olson; Joseph L.
CPC
G10L15/22; G06F3/013; A63F13/212; G09G5/38; G06F3/011; A63F13/25; G02B27/0172; G06T19/20
Verdict
Medium Hardware
Source
Google Patents · FreePatentsOnline

The keeper's note

Calibration of virtual image displays.

Abstract

Systems, methods and articles of manufacture for calibrating an augmented reality headset. Embodiments output for display in the augmented reality headset, a plurality of reference points, where the augmented reality headset is adapted to further display a fixed reference line. A user selection of a first one of the plurality of reference points that appears closest to the fixed reference line is received, and a calibration profile for the augmented reality headset is generated based on the user selection of the first reference point. Embodiments render one or more frames for display, in which a depiction of at least one virtual object within the one or more frames is dynamically generated based at least in part on the calibration profile.

Background

BACKGROUND(1) Field of the Invention(2) The present invention generally relates to entertainment systems, and more specifically to techniques for calibrating an augmented reality headset coupled with a mobile device.(3) Description of the Related Art(4) Computer graphics technology has come a long way since video games were first developed. Relatively inexpensive 3D graphics engines now provide nearly photo-realistic interactive game play on hand-held video game, home video game and personal computer hardware platforms costing only a few hundred dollars. These video game systems typically include a hand-held controller, game controller, or, in the case of a hand-held video game platform, an integrated controller. A user interacts with the controller to send commands or other instructions to the video game system to control a video game or other simulation. For example, the controller may include a joystick and buttons operated by the user.(5) While video games allow the user to interact directly with the video game system, such interactions primarily influence the graphical depiction shown on the video game device (or on a connected display), and rarely influence any other objects outside of the virtual world. That is, a user may specify an input to the video game system, indicating that the user's avatar should perform a jump action, and in response the video game system could display the user's avatar jumping. However, such interactions are typically limited to the virtual

Claims

1. A method of calibrating an augmented reality headset, the method comprising: outputting for display in the augmented reality headset, a plurality of reference points, wherein the augmented reality headset is adapted to further display a fixed reference line, wherein each of the plurality of reference points comprises a respective one of a plurality of illuminated light-emitting diodes, wherein each of the plurality of illuminated light-emitting diodes has a distinct color among the plurality of illuminated light-emitting diodes; receiving a user selection of a first one of the plurality of reference points that appears closest to the fixed reference line; generating a calibration profile for the augmented reality headset based on the user selection of the first reference point, the calibration profile describing a relative position of a wearer's eye with respect to a display of the augmented reality headset; and rendering one or more frames for display, in which a depiction of at least one virtual object within the one or more frames is dynamically generated based at least in part on the calibration profile. 2. The method of claim 1, wherein the fixed reference line further comprises a physical reference line positioned at least one of above and below a display device of the augmented reality headset. 3. The method of claim 2, wherein the augmented reality headset comprises a mobile device adapter adapted to hold an inserted mobile device, wherein the display device is a display screen of the inserted mobile device. 4. The method of claim 3, wherein the augmented reality headset further comprises a beam splitter and a see-through mirror configured to redirect light from the display screen of the inserted mobile device to a view of a wearer of the augmented reality headset. 5. The method of claim 1, wherein each of the plurality of reference points comprises a respective vertical line on a graphical user interface of the augmented reality headset. 6. The method of claim 1, wherein the fixed reference line comprises a vertical line displayed in a fixed position on a graphical user interface of the augmented reality headset. 7. The method of claim 6, wherein receiving the user selection further comprises: capturing user speech data using one or more microphone sensor devices of the augmented reality headset; and performing a speech-to-text analysis of the captured user speech data in order to determine which of the plurality of illuminated light-emitting diodes corresponds to the captured user speech data. 8. The method of claim 1, wherein generating the calibration profile for the augmented reality headset comprises: determining a first eye position of a wearer of the augmented reality headset, relative to a display surface of the augmented reality headset, based on the user selection of the first reference point being closest to the fixed reference line. 9. The method of claim 1, wherein the calibration profile generated based on the user selection of the first reference point defines calibration information for a first eye of a wearer of the augmented reality headset, and wherein the limitations of outputting, receiving and generating are repeated for a second eye of the wearer of the augmented reality headset. 10. The method of claim 1, wherein rendering the one or more frames for display, in which the depiction of the at least one virtual object within the one or more frames is dynamically generated based at least in part on the calibration profile, further comprises: configuring one or more shaders, using the calibration profile, to offset any parallax errors when the one or more frames are viewed by a wearer of the augmented reality headset. 11. The method of claim 1, wherein the fixed reference line comprises one of a plurality of physical reference lines, wherein rendering the one or more frames for display, in which the depiction of the at least one virtual object within the one or more frames is dynamically generated based at least in part on the calibration profile, further comprises: adjusting a view point of a virtual scene, based on the user selection of the first reference point and based further on predefined data indicating a fixed position of at least one of the plurality of physical reference lines. 12. A non-transitory computer-readable medium containing computer program code that, when executed by operation of one or more computer processors, performs an operation for calibrating an augmented reality headset, the operation comprising: outputting for display in the augmented reality headset, a plurality of reference points, wherein the augmented reality headset is adapted to further display a fixed reference line, wherein each of the plurality of reference points comprises a respective one of a plurality of illuminated light-emitting diodes, wherein each of the plurality of illuminated light-emitting diodes has a distinct color among the plurality of illuminated light-emitting diodes; receiving a user selection of a first one of the plurality of reference points that appears closest to the fixed reference line; generating a calibration profile for the augmented reality headset based on the user selection of the first reference point, the calibration profile describing a relative position of a wearer's eye with respect to a display of the augmented reality headset; and rendering one or more frames for display, in which a depiction of at least one virtual object within the one or more frames is dynamically generated based at least in part on the calibration profile. 13. The non-transitory computer-readable medium of claim 12, wherein the fixed reference line further comprises a physical reference line positioned at least one of above and below a display device of the augmented reality headset. 14. The non-transitory computer-readable medium of claim 13, wherein the augmented reality headset comprises a mobile device adapter adapted to hold an inserted mobile device, wherein the display device is a display screen of the inserted mobile device, and wherein the augmented reality headset further comprises a beam splitter and a see-through mirror configured to redirect light from the display screen of the inserted mobile device to a view of a wearer of the augmented reality headset. 15. The non-transitory computer-readable medium of claim 12, wherein the fixed reference line comprises a vertical line displayed in a fixed position on a graphical user interface of the augmented reality headset, and wherein receiving the user selection further comprises: capturing user speech data using one or more microphone sensor devices of the augmented reality headset; and performing a speech-to-text analysis of the captured user speech data in order to determine which of the plurality of illuminated light-emitting diodes corresponds to the captured user speech data. 16. The non-transitory computer-readable medium of claim 12, wherein generating the calibration profile for the augmented reality headset comprises: determining a first eye position of a wearer of the augmented reality headset, relative to a display surface of the augmented reality headset, based on the user selection of the first reference point being closest to the fixed reference line. 17. The non-transitory computer-readable medium of claim 12, wherein the fixed reference line comprises one of a plurality of physical reference lines, wherein rendering the one or more frames for display, in which the depiction of the at least one virtual object within the one or more frames is dynamically generated based at least in part on the calibration profile, further comprises: configuring one or more shaders, using the calibration profile, to offset any parallax errors when the one or more frames are viewed by a wearer of the augmented reality headset; and adjusting a view point of a virtual scene, based on the user selection of the first reference point and based further on predefined data indicating a fixed position of at least one of the plurality of physical reference lines. 18. An augmented reality headset, comprising: one or more computer processors; and a memory containing computer program code that, when executed by operation of the one or more computer processors, performs an operation for calibrating the augmented reality headset, the operation comprising: outputting for display in the augmented reality headset, a plurality of reference points, wherein the augmented reality headset is adapted to further display a fixed reference line, wherein each of the plurality of reference points comprises a respective one of a plurality of illuminated light-emitting diodes, wherein each of the plurality of illuminated light-emitting diodes has a distinct color among the plurality of illuminated light-emitting diodes; receiving a user selection of a first one of the plurality of reference points that appears closest to the fixed reference line; generating a calibration profile for the augmented reality headset based on the user selection of the first reference point, the calibration profile describing a relative position of a wearer's eye with respect to a display of the augmented reality headset; and rendering one or more frames for display, in which a depiction of at least one virtual object within the one or more frames is dynamically generated based at least in part on the calibration profile. 19. The augmented reality headset of claim 18, wherein the fixed reference line further comprises a physical reference line positioned at least one of above and below a display device of the augmented reality headset. 20. The augmented reality headset of claim 18, wherein each of the plurality of reference points comprises a respective vertical line on a graphical user interface of the augmented reality headset.