AMBIENT LIGHT CHARACTERIZATION

Number: 20190114828
Published: 2019-04-18
Filed: 2017-10-13
Assignee: Disney Enterprises, Inc.
Inventors: TROWBRIDGE; Robert Scott
CPC: G06T15/80; G06T15/506; H04B10/116; G06T19/006
Verdict: Low Notable software
Source: Google Patents · FreePatentsOnline

The keeper's note

Ambient light characterization (AR lighting estimation).

Abstract

Embodiments herein describe an AR system which communicates with light sources in a real world environment to simulate the light sources having an effect on AR content being displayed in the AR system. In one embodiment, the AR system determines the light characteristics of the light sources such as their color, specularity, beam spread, brightness, or illumination pattern. These light characteristics can contribute to the ambient light in the real world environment which affects the appearance of the physical objects in the environment. The AR system can adjust how the AR content is displayed to simulate the AR content being affected in a similar manner by the light sources. As such, the AR content appears to be more like a physical object (rather than a virtual object) thereby providing the user with a more immersive experience.

Background

BACKGROUNDField of the Invention

The embodiments herein are generally directed to characterizing an effect of a light source in a real world environment on augmented reality (AR) content displayed using an AR system.Description of the Related Art

AR displays insert virtual content into real-world views of the user's environment. For example, a user may wear a headset that captures views of the real world and includes a lens and a display device that outputs AR content. For example, the AR content may include a virtual object such as a cartoon character that is inserted into the real world environment. The AR display can cause the cartoon character to move and interact with physical objects in the real world environment such as standing on a table, climbing on a box, etc.

In some AR systems, the appearance of the AR content is improved by first occluding a portion of the real-world image before combining the real-world image and the AR content. For example, the AR display can control a first display to generate an opaque portion with the same outline as the cartoon character. Because the AR content is combined with the real-world image at the location of the black silhouette, the appearance of the AR content is more vibrant, high-contrast, and can include the color black. Although this technique can make the AR content appear more realistic, it does not consider the ambient light. For example, a light source in the real world environment can be a colored ligh

Claims

1. An augmented reality (AR) system, comprising: a display configured to output AR content to overlay a portion of a real world environment viewable through the display; a visible light communication (VLC) communicator configured to receive VLC signals transmitted from a VLC light source in the real world environment, wherein the VLC signals comprise data indicating light source characteristics of the VLC light source; and an AR generator configured to determine, based on the light source characteristics, display characteristics for the AR content to simulate an effect of the VLC light source on the AR content. 8. A computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code, when executed by a processor, performs an operation, the operation comprising: outputting AR content in a display, wherein the AR content overlays a portion of a real world environment viewable through the display; receiving data transmitted from a VLC light source in the real world environment using VLC signals, wherein the data comprises light source characteristics of the VLC light source; and determining, based on the light source characteristics, display characteristics for the AR content to simulate an effect of the VLC light source on the AR content. 15. A communication system, comprising: an intelligent light source; and an AR system, comprising: a display configured to output AR content to overlay a portion of a real world environment viewable through the display; a communicator configured to receive signals transmitted from the intelligent light source, wherein the signals comprise data indicating a light source characteristic of the intelligent light source; and an AR generator configured to determine, based on the light source characteristic, display characteristics for the AR content to simulate an effect of the intelligent light source on the AR content.