- Number
- 11216665
- Published
- 2022-01-04
- Filed
- 2019-08-15
- Assignee
- Disney Enterprises, Inc.
- Inventors
- Drake; Corey D., Panec; Timothy M., Medrano; Tritia V., Thornton; Stephen A., Yeung; Jason A., Nocon; Nathan D., Baumbach; Elliott H.
- CPC
- H04W4/029; G06V20/20; G06F16/587; H04L67/131; H04L67/12; G06T19/006; G06F16/5866; G06T7/70; H02J50/20; H04W4/021
- Verdict
- Low Notable software
- Source
- Google Patents · FreePatentsOnline
The keeper's note
Mapping real-world features into virtual/AR space (granted, with wireless-power signal).
Abstract
Embodiments provide for an augmented reality (AR) system able to track the movement of real-world objects and apply that movement to virtual objects. The AR system includes a radio configured to receive first sensor data from a sensor attached to a first physical object in physical space. The AR system further includes a processor configured to determine when a physical object changes from a first state to a second state object based on the first sensor data, and update an environmental map based on the change from the first state to the second state of the first physical object.
Background
BACKGROUND (1) In many instances, one or more mapping algorithms are utilized to generate and/or update environmental maps utilized by an augmented reality (AR) system. The mapping algorithms generate virtual depictions of real-world objects within the environmental maps. One example mapping algorithm is a simultaneous localization and mapping (SLAM) algorithm. However, the mapping algorithms are often unable to properly map moving real-world objects, resulting in artifacts and/or misrepresented real-world objects. For example, an AR object may not be moved or moved too slowly in response to movement of a corresponding real-world object, resulting in a poor user experience. In some instances, tracking system may be utilized to track the movement of real-world objects and aid in updating environmental maps. However, these tracking systems are expensive and complex, limiting the possible applications in which such tracking systems may be utilized. SUMMARY (2) In one embodiment, a method for updating an environmental map of an augmented reality (AR) system comprises receiving first sensor data from a sensor attached to a first physical object in physical space and determining a change from a first state to a second state of the first physical object based on the first sensor data. The method further comprises updating the environmental map based on the change from the first state to the second state of the first physical object, and updating a presentation based on the updated e
Claims
1. A method for updating an environmental map of an augmented reality (AR) system, the method comprising: receiving first sensor data, first calibration data, and second calibration data from a first sensor attached to a first physical object in physical space, wherein the first calibration data corresponds to a first state associated with a first position of the first physical object in the physical space, and the second calibration data corresponds to a second state associated with a second position of the first physical object in the physical space, the first position differing from the second position; determining a change from the first state to the second state based on a comparison of the first sensor data to the first calibration data, and a comparison of the first sensor data to the second calibration data; receiving second sensor data from a second sensor in the physical space; determining a change of an amount of light within the physical space based on the second sensor data; updating a first virtual object corresponding to the first physical object within the environmental map based on the change from the first state to the second state; updating illumination within the environmental map based on the change of the amount of light within the physical space; updating a second virtual object within the environmental map based on the second sensor data, wherein the second virtual object corresponds to a second physical object within the physical space; and updating a presentation based on the updated first virtual object, the updated second virtual object, and the updated illumination. ||
10. A non-transitory computer-readable medium containing computer program code that, when executed by operation of one or more computer processors, performs an operation comprising: receiving first sensor data, first calibration data, and second calibration data from a first sensor attached to a first physical object in physical space, wherein the first calibration data corresponds to a first state associated with a first position of the first physical object in the physical space, and the second calibration data corresponds to a second state associated with a second position of the first physical object in the physical space, the first position differing from the second position; determining a change from the first state to the second state based a comparison of the first sensor data to the first calibration data, and a comparison of the first sensor data to the second calibration data; receiving second sensor data from a second sensor in the physical space; determining a change of an amount of light within the physical space based on the second sensor data; updating a first virtual object corresponding to the first physical object within an environmental map based on the change from the first state to the second state; updating illumination within the environmental map based on the change of the amount of light within the physical space; updating a second virtual object within the environmental map based on the second sensor data, wherein the second virtual object corresponds to a second physical object within the physical space; and displaying the updated first virtual object, the updated second virtual object, and the updated illumination on a display of an augmented reality system. ||
15. An augmented reality system, comprising: a display; a radio configured to: receive first sensor data, first calibration data, and second calibration data from a first sensor attached to a first physical object in physical space, wherein the first calibration data corresponds to a first state associated with a first position of the first physical object in the physical space, and the second calibration data corresponds to a second state associated with a second position of the first physical object in the physical space, the first position differs from the second position; and receive second sensor data from a second sensor in the physical space; and a processor configured to: determine a change from the first state to the second state based on a comparison of the first sensor data to the first calibration data, and a comparison of the first sensor data to the second calibration data; determine a change of an amount of light within the physical space based on the second sensor data; update a first virtual object corresponding to the first physical object within an environmental map based on the change from the first state to the second state; update illumination within the environmental map based on the change of the amount of light within the physical space; update a second virtual object within the environmental map based on the second sensor data, wherein the second virtual object corresponds to a second physical object within the physical space; and displaying the updated first virtual object, the updated second virtual object, and the updated illumination on the display.