Multi-device interaction with an immersive environment

Number: 10594786
Published: 2020-03-17
Filed: 2017-10-11
Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
Inventors: Perez, III; Jose, Dollar; Peter, Moshe; Barak
CPC: G06T7/73; H04L67/104; G06F3/0346; G06F3/04847; G02B27/017; G06T19/20; G06T7/97; G06F3/04845; G06F3/0482; G06F3/04842; G06F3/0488; G06F3/0484; H04L67/125; G06F3/04815; G06F3/011
Verdict: Medium Notable software
Source: Google Patents · FreePatentsOnline

The keeper's note

Multi-device interaction with immersive virtual-production environment.

Abstract

Views of a virtual environment can be displayed on mobile devices in a real-world environment simultaneously for multiple users. The users can operate selections devices in the real-world environment that interact with objects in the virtual environment. Virtual characters and objects can be moved and manipulated using selection shapes. A graphical interface can be instantiated and rendered as part of the virtual environment. Virtual cameras and screens can also be instantiated to created storyboards, backdrops, and animated sequences of the virtual environment. These immersive experiences with the virtual environment can be used to generate content for users and for feature films.

Background

TECHNICAL FIELD(1) This application discloses technology related to the fields of computer animation, virtual reality environments, and digital content generation. Specifically, this application discloses technology for using a virtual reality environment to pose and animate characters during a pre-visualization phase of a content creation pipeline.BACKGROUND(2) Previsualization, or “previz”, is a method by which complex scenes can be visualized before the creation of digital content. Previsualization has traditionally used still photography, storyboard techniques, and hand sketches to generate a linear sequence of images or scenes that together define a plan for a later sequence of video images. Previsualization allows a director, cinematographer, or visual effects supervisor to not only visualize the way in which a scene may be recorded, but it also allows them to experiment with different staging, lighting, character movements, art direction, camera placement, recording techniques, and so forth. In real-world sets, the director can “walk the set” prior to a video shoot to get a feel for how different aspects of the scene will affect the overall recording. The director may choose to move character or scenery positions, alter lighting, change camera angles, and so forth, during the previsualization stage to minimize the chance of error during the actual filming of the scene.(3) Digital previsualization applies computer animation technology to the traditional previsualization

Claims

1. A method comprising: causing a virtual environment to be displayed on a display of a first mobile device in a real-world environment; receiving one or more first inputs from a first selection device associated with the first mobile device to change one or more aspects of the virtual environment; causing the virtual environment to be displayed on a display of a second mobile device in the real-world environment; receiving one or more second inputs from a second selection device associated with the second mobile device to change one or more aspects of a virtual camera positioned in the virtual environment to capture the one or more aspects of the virtual environment that are changed by the one or more first inputs from the first selection device, wherein the virtual camera is different from virtual cameras used to view the virtual environment through the first mobile device and the second mobile device. 10. A system comprising: one or more processors; and one or more memories comprising instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising: causing a virtual environment to be displayed on a display of a first mobile device in a real-world environment; receiving one or more first inputs from a first selection device associated with the first mobile device to change one or more aspects of the virtual environment; causing the virtual environment to be displayed on a display of a second mobile device in the real-world environment; receiving one or more second inputs from a second selection device associated with the second mobile device to change one or more aspects of a virtual camera positioned in the virtual environment to capture the one or more aspects of the virtual environment that are changed by the one or more first inputs from the first selection device, wherein the virtual camera is different from virtual cameras used to view the virtual environment through the first mobile device and the second mobile device. 16. A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising: causing a virtual environment to be displayed on a display of a first mobile device in a real-world environment; receiving one or more first inputs from a first selection device associated with the first mobile device to change one or more aspects of the virtual environment; causing the virtual environment to be displayed on a display of a second mobile device in the real-world environment; receiving one or more second inputs from a second selection device associated with the second mobile device to change one or more aspects of a virtual camera positioned in the virtual environment to capture the one or more aspects of the virtual environment that are changed by the one or more first inputs from the first selection device, wherein the virtual camera is different from virtual cameras used to view the virtual environment through the first mobile device and the second mobile device.