Enhanced Vision System and Method

Number: 20210383595
Published: 2021-12-09
Filed: 2020-06-03
Assignee: Disney Enterprises, Inc.
Inventors: Chapman; Steven M., Deuel; Matthew, Baker; Daniel, Coffey; Dane, Mine; Mark R., Goldberg; Evan
CPC: G01S17/89; G06F1/163; G06F3/011; G06T15/205; G06T7/579; H04W4/026; H04W4/029
Verdict: Low Hardware
Source: Google Patents · FreePatentsOnline

The keeper's note

Wearable LIDAR-based enhanced vision sensing hardware.

Abstract

In one implementation, an enhanced vision system includes a portable user device, a base station including a hardware processor and a memory storing a virtual effects rendering software code, and a display device communicatively coupled to the base station. The hardware processor executes the virtual effects rendering software code to detect the presence of the portable user device in a real-world environment, obtain a mapping of the real-world environment, and identify one or more virtual effect(s) for display in the real-world environment. The hardware processor further executes the virtual effects rendering software code to detect actuation of the portable user device, and to control the display device to display the virtual effect(s) in the real-world environment based on the mapping, and the position and orientation of the portable user device during the detected actuation.

Background

BACKGROUND

In augmented reality (AR), the appearance of real-world objects and/or environments can be digitally modified using virtual imagery to provide a user with the illusion of having enhanced vision, such as the illusion of having “x-ray” vision enabling the user to see features obscured by an opaque surface. AR is increasingly used to produce entertainment experiences that are more immersive and engaging. Moreover, AR can be used to modify images of the real-world through augmentation in ways that have a wide variety of practical applications beyond entertainment. However, a user wishing to experience the enhanced vision made possible by AR must typically view real-world objects through AR glasses or using an AR headset in order to see those real-world objects overlaid by virtual projections.

Unfortunately, AR glasses and headsets can be costly and inconvenient to wear. In addition, the increased concern over the spread of communicable disease will likely mandate burdensome sanitation procedures in usage environments in which wearable AR viewing equipment is shared by multiple users. Moreover, requiring the use of an AR headset or glasses to enjoy an enhanced vision experience effectively precludes multiple users from sharing the same experience. Consequently, there is a need in the art for an AR solution enabling one or more users to enjoy enhanced vision without requiring the user or users to don AR eyewear or headgear. SUMMARY

There are provided

Claims

1: An enhanced vision system comprising: a base station including a hardware processor and a memory storing a virtual effects rendering software code; a display device situated in a real-world environment having one or more surfaces and communicatively coupled to the base station; and a portable user device separate from the base station and the display device; wherein the base station is configured to track the portable user device; and wherein the hardware processor is configured to execute the virtual effects rendering software code to: detect the portable user device in the real-world environment; obtain a mapping of the real-world environment; identify one or more virtual effects for display by the display device on the one or more surfaces in the real-world environment; detect, based on tracking the portable device in the real-world environment, a position and an orientation of the portable user device in the real-world environment indicative of the portable user device being pointed at a first surface of the one or more surfaces in the real-world environment; and control, based on detecting, the display device to display the one or more virtual effects on the first surface in the real-world environment based on the mapping, and the position and h orientation of the portable user device. || 11: A method for use by an enhanced vision system including a base station having a hardware processor and a memory storing a virtual effects rendering software code, a display device situated in a real-world environment having one or more surfaces and communicatively coupled to the base station, and a portable user device separate from the base station and the display device, the base station being configured to track the portable user device, the method comprising: detecting, by the virtual effects rendering software code executed by the hardware processor, the portable user device in h real-world environment; obtaining, by the virtual effects rendering software code executed by the hardware processor, a mapping of the real-world environment; identifying, by the virtual effects rendering software code executed by the hardware processor, one or more virtual effects for display by the display device on the one or more surfaces in the real-world environment; detecting, by the virtual effects rendering software code executed by the hardware processor and based on tracking the portable device in the real-world environment, a position and an orientation of the portable user device in the real-world environment indicative of the portable user device being pointed at a first surface of the one or more surfaces in the real-world environment; and controlling, by the virtual effects rendering software code executed by the hardware processor and based on detecting, the display device to display the one or more virtual effects on the first surface in the real-world environment based on the mapping, and the position and the orientation of the portable user device.