CREATING SHADOWS IN MIXED REALITY

Number: 20200265638
Published: 2020-08-20
Filed: 2019-02-20
Assignee: Lucasfilm Entertainment Company Ltd. LLC
Inventors: Koperwas; Michael, Latta; Lutz
CPC: G02B27/017; G06T7/11; G06T19/006; G06T17/00; G06T15/60
Verdict: Medium Notable software
Source: Google Patents · FreePatentsOnline

The keeper's note

Rendering technique for shadows in mixed reality.

Abstract

Implementations of the disclosure are directed to generating shadows in the physical world that correspond to virtual objects displayed on MR displays. In some implementations, a method includes: synchronously presenting a version of a scene on each of a MR display system and a projector display system, where during presentation: the MR display system displays a virtual object overlaid over a view of a physical environment; and a projector of the projector display system creates a shadow on a surface in the physical environment, the created shadow corresponding to the virtual object displayed by the MR display. In some implementations, the method includes: loading in a memory of the MR display system, a first version of the scene including the virtual object; and loading in a memory of the projector display system a second version of the scene including a virtual surface onto which the virtual object casts a shadow.

Background

SUMMARY

Implementations of the disclosure are directed to using a light projection device in a physical environment (i.e., the real-world) to generate shadows corresponding to virtual objects displayed on mixed reality (“MR”) display systems.

In one embodiment, a method includes: synchronously presenting a version of a scene on each of a mixed reality display system and a projector display system, where during presentation: the mixed reality display system displays a virtual object overlaid over a view of a physical environment; and a projector of the projector display system creates a shadow on a surface in the physical environment, the created shadow corresponding to the virtual object displayed by the mixed reality display system. Prior to presentation of the scene, virtual positions of the projector display system and the mixed reality display system in a virtual world may be aligned with actual positions of the projector display system and mixed reality display system in the physical environment.

In implementations, the method further includes: loading in a memory of the mixed reality display system, a first version of the scene, the first version of the scene including the virtual object; and loading in a memory of the projector display system, a second version of the scene, the second version of the scene including a virtual surface onto which the virtual object casts a shadow.

In implementations, synchronously presenting a version of the scene

Claims

1. A method, comprising: synchronously presenting a version of a scene on each of a mixed reality display system and a projector display system, wherein during presentation: the mixed reality display system displays a virtual object overlaid over a view of a physical environment; and a projector of the projector display system creates a shadow on a surface in the physical environment, the created shadow corresponding to the virtual object displayed by the mixed reality display system. 11. A system, comprising: a mixed reality display system comprising: a display configured to present a virtual object overlaid over a view of a physical environment; and a projector display system comprising: a projector configured to project an image on a surface in the physical environment, wherein the projected image comprises a shadow corresponding to a shadow cast by the virtual object. 18. A non-transitory computer readable medium having executable instructions stored thereon, that when executed by a processor, performs operations of: loading in a memory a scene, the loaded scene comprising a virtual surface onto which a virtual object casts a shadow; and causing a projector display system to present the loaded scene, wherein during presentation, a projector of the projector display system creates a shadow on a surface in a physical environment, the created shadow corresponding to the shadow cast by the virtual object in the scene.