Multi-device interaction with an immersive environment

Number: 11238619
Published: 2022-02-01
Filed: 2020-03-16
Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
Inventors: Perez, III; Jose, Dollar; Peter, Moshe; Barak
CPC: G06F3/04847; H04L67/125; G06T7/73; G02B27/017; G06F3/0346; G06T19/20; G06F3/04845; G06F3/011; G06F3/0482; G06F3/04815; G06T7/97; G06F3/04842; G06F3/0488; G06F3/0484; H04L67/104
Verdict: Medium Notable software
Source: Google Patents · FreePatentsOnline

The keeper's note

Multi-device interaction technique for immersive/virtual-production environments.

Abstract

Views of a virtual environment can be displayed on mobile devices in a real-world environment simultaneously for multiple users. The users can operate selections devices in the real-world environment that interact with objects in the virtual environment. Virtual characters and objects can be moved and manipulated using selection shapes. A graphical interface can be instantiated and rendered as part of the virtual environment. Virtual cameras and screens can also be instantiated to created storyboards, backdrops, and animated sequences of the virtual environment. These immersive experiences with the virtual environment can be used to generate content for users and for feature films.

Background

TECHNICAL FIELD (1) This application discloses technology related to the fields of computer animation, virtual reality environments, and digital content generation. Specifically, this application discloses technology for using a virtual reality environment to pose and animate characters during a pre-visualization phase of a content creation pipeline. BACKGROUND (2) Previsualization, or “previz”, is a method by which complex scenes can be visualized before the creation of digital content. Previsualization has traditionally used still photography, storyboard techniques, and hand sketches to generate a linear sequence of images or scenes that together define a plan for a later sequence of video images. Previsualization allows a director, cinematographer, or visual effects supervisor to not only visualize the way in which a scene may be recorded, but it also allows them to experiment with different staging, lighting, character movements, art direction, camera placement, recording techniques, and so forth. In real-world sets, the director can “walk the set” prior to a video shoot to get a feel for how different aspects of the scene will affect the overall recording. The director may choose to move character or scenery positions, alter lighting, change camera angles, and so forth, during the previsualization stage to minimize the chance of error during the actual filming of the scene. (3) Digital previsualization applies computer animation technology to the traditional previsualiza

Claims

1. A method comprising: causing a virtual scene to be display on a virtual-reality device in a real-world environment, wherein the virtual scene is part of a movie, and wherein the virtual-reality device allows a first user to move through the virtual scene as part of a previsualization process for the movie; receiving changes to the virtual scene from the first user as the first user moves through the virtual scene using the virtual-reality device; receiving a video of a performance from a second user in the real-world environment; and rendering a video of the virtual scene composited with the video of the performance of the second user in the real-world environment to create a scene for the movie. || 8. A system comprising: one or more processors; and one or more memories comprising instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising: causing a virtual scene to be display on a virtual-reality device in a real-world environment, wherein the virtual scene is part of a movie, and wherein the virtual-reality device allows a first user to move through the virtual scene as part of a previsualization process for the movie; receiving changes to the virtual scene from the first user as the first user moves through the virtual scene using the virtual-reality device; receiving a video of a performance from a second user in the real-world environment; and rendering a video of the virtual scene composited with the video of the performance of the second user in the real-world environment to create a scene for the movie. || 16. A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising: causing a virtual scene to be display on a virtual-reality device in a real-world environment, wherein the virtual scene is part of a movie, and wherein the virtual-reality device allows a first user to move through the virtual scene as part of a previsualization process for the movie; receiving changes to the virtual scene from the first user as the first user moves through the virtual scene using the virtual-reality device; receiving a video of a performance from a second user in the real-world environment; and rendering a video of the virtual scene composited with the video of the performance of the second user in the real-world environment to create a scene for the movie.