- Number
- 10846920
- Published
- 2020-11-24
- Filed
- 2019-02-20
- Assignee
- LUCASFILM ENTERTAINMENT COMPANY LTD. LLC
- Inventors
- Koperwas; Michael, Latta; Lutz
- CPC
- G06T19/006; G06T7/11; G06T15/60; G06T17/00; G02B27/017
- Verdict
- Medium Notable software
- Source
- Google Patents · FreePatentsOnline
The keeper's note
Rendering technique for shadows in mixed reality (granted).
Abstract
Implementations of the disclosure are directed to generating shadows in the physical world that correspond to virtual objects displayed on MR displays. In some implementations, a method includes: synchronously presenting a version of a scene on each of a MR display system and a projector display system, where during presentation: the MR display system displays a virtual object overlaid over a view of a physical environment; and a projector of the projector display system creates a shadow on a surface in the physical environment, the created shadow corresponding to the virtual object displayed by the MR display. In some implementations, the method includes: loading in a memory of the MR display system, a first version of the scene including the virtual object; and loading in a memory of the projector display system a second version of the scene including a virtual surface onto which the virtual object casts a shadow.
Background
SUMMARY(1) Implementations of the disclosure are directed to using a light projection device in a physical environment (i.e., the real-world) to generate shadows corresponding to virtual objects displayed on mixed reality (“MR”) display systems.(2) In one embodiment, a method includes: synchronously presenting a version of a scene on each of a mixed reality display system and a projector display system, where during presentation: the mixed reality display system displays a virtual object overlaid over a view of a physical environment; and a projector of the projector display system creates a shadow on a surface in the physical environment, the created shadow corresponding to the virtual object displayed by the mixed reality display system. Prior to presentation of the scene, virtual positions of the projector display system and the mixed reality display system in a virtual world may be aligned with actual positions of the projector display system and mixed reality display system in the physical environment.(3) In implementations, the method further includes: loading in a memory of the mixed reality display system, a first version of the scene, the first version of the scene including the virtual object; and loading in a memory of the projector display system, a second version of the scene, the second version of the scene including a virtual surface onto which the virtual object casts a shadow.(4) In implementations, synchronously presenting a version of the scene on each of t
Claims
1. A method, comprising: loading, in a memory of a mixed reality display system, one or more first scene files of a scene, the one or more first scene files comprising data for a virtual object; loading, in a memory of a projector display system, one or more second scene files of the scene, the one or more second scene files comprising data for a virtual surface associated with a shadow of the virtual object; and after loading the one or more first scene files and the one or more second scene files, synchronously: displaying, at the mixed reality display system, based on the one or more first scene files, the virtual object overlaid over a view of a physical environment; and projecting, using a projector of the projector display system, based on the one or more second scene files, a projection corresponding to the shadow on a surface in the physical environment.
10. A system, comprising: a mixed reality display system comprising a display and a memory, the mixed reality display system configured to: load, in the memory of the mixed reality display system, one or more first scene files of a scene, the one or more first scene files comprising data for a virtual object; display, on the display, based on the one or more first scene files, the virtual object overlaid over a view of a physical environment; and a projector display system comprising a memory and a projector, the projector display system configured to: load, in the memory of the projector display system, one or more second scene files of the scene, the one or more second scene files comprising data for a virtual surface associated with a shadow of the virtual object; and project, using the projector, based on the one or more second scene files, a projection corresponding to the shadow on a surface in the physical environment, wherein the mixed reality display system and the projector display system are configured to synchronously display the virtual object and project the projection corresponding to the shadow.
15. One or more non-transitory computer readable mediums storing instructions executable by one or more processors, wherein execution of the instructions cause the one or more processors to perform operations comprising: loading, in a memory of a mixed reality display system, one or more first scene files of a scene, the one or more first scene files comprising data for a virtual object; loading, in a memory of a projector display system, one or more second scene files of the scene, the one or more second scene files comprising data for a virtual surface associated with a shadow of the virtual object; and after loading the one or more first scene files and the one or more second scene files, synchronously: displaying, at the mixed reality display system, based on the one or more first scene files, the virtual object overlaid over a view of a physical environment; and projecting, using a projector of the projector display system, based on the one or more second scene files, a projection corresponding to the shadow on a surface in the physical environment.