DEAD RECKONING POSITIONAL PREDICTION FOR AUGMENTED REALITY AND VIRTUAL REALITY APPLICATIONS

Number: 20200082548
Published: 2020-03-12
Filed: 2018-09-06
Assignee: Disney Enterprises, Inc.
Inventors: GRAHAM; Todd Michael, NELSON; Amy E.
CPC: G06T7/74; G06T19/006; G06F3/011; G02B27/0172; G01C21/1656; G06F3/012; G06F3/0346; G06T19/00; G06T7/248
Verdict: Low Hardware
Source: Google Patents · FreePatentsOnline

The keeper's note

Positional tracking/prediction technique for AR/VR headsets.

Abstract

Techniques for predicting a virtual camera view in an augmented reality (AR) or virtual reality (VR) application. A first change in position of a user device over a first time period is determined based on analyzing a plurality of frames of image data related to an AR or VR application. A dead reckoning calculation is used to predict a second change in position of the user device over a second time period, based on the first change in position and data received from an Inertial Measurement Unit (IMU) associated with the user device. A plurality of frames of image data are generated for display in the AR or VR application, based on the predicted second change in position of the user device.

Background

BACKGROUNDField of the Invention

This disclosure relates in general to virtual reality (VR) and augmented reality (AR), and more particularly, though not exclusively, to dead reckoning positional prediction in an AR or VR application.Description of the Related Art

Computer graphics technology has significantly progressed since the first applications were developed. Relatively inexpensive 3D graphics engines now provide nearly photo-realistic interactive applications on hand-held devices and personal computer platforms. These video game systems typically include a hand-held controller, game controller, or, in the case of a hand-held video game platform, an integrated controller. A user interacts with the controller to send commands or other instructions to the video game system to control a video game or other simulation. For example, the controller may include a joystick and buttons operated by the user.

While video games allow the user to interact directly with the video game system, such interactions primarily influence the graphical depiction shown on the video game device (or on a connected display), and rarely influence any other objects outside of the virtual world. That is, a user may specify an input to the video game system, indicating that the user's avatar should perform a jump action, and in response the video game system could display the user's avatar jumping. However, such interactions are typically limited to the virtual world, and any intera

Claims

1. A method of predicting a virtual camera view in an augmented reality (AR) or virtual reality (VR) application, comprising: determining a first change in position of a user device over a first time period based on analyzing a plurality of frames of image data related to an AR or VR application; predicting a second change in position of the user device over a second time period, using a dead reckoning calculation and based on the first change in position and data received from an Inertial Measurement Unit (IMU) associated with the user device; and generating a plurality of frames of image data for display in the AR or VR application, based on the predicted second change in position of the user device. 10. A computer program product for predicting a virtual camera view in an AR or VR application, the computer program product comprising: a computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code executable by one or more computer processors to perform an operation, the operation comprising: determining a first change in position of a user device over a first time period based on analyzing a plurality of frames of image data related to an AR or VR application; predicting a second change in position of the user device over a second time period, using a dead reckoning calculation and based on the first change in position and data received from an Inertial Measurement Unit (IMU) associated with the user device; and generating a plurality of frames of image data for display in the AR or VR application, based on the predicted second change in position of the user device. 16. A system, comprising: a processor; and a memory storing a program, which, when executed on the processor, performs an operation, the operation comprising: determining a first change in position of a user device over a first time period based on analyzing a plurality of frames of image data related to an AR or VR application; predicting a second change in position of the user device over a second time period, using a dead reckoning calculation and based on the first change in position and data received from an Inertial Measurement Unit (IMU) associated with the user device; and generating a plurality of frames of image data for display in the AR or VR application, based on the predicted second change in position of the user device.