Content generation in an immersive environment

Number: 10373342
Published: 2019-08-06
Filed: 2017-10-11
Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
Inventors: Perez, III; Jose, Dollar; Peter, Moshe; Barak
CPC: G06F3/011; G02B27/017; G06F3/0482; G06T7/73; G06F3/0346; G06F3/04842; H04L67/104; G06F3/04845; G06F3/04847; H04L67/125; G06T7/97; G06F3/0484; G06F3/04815; G06F3/0488; G06T19/20
Verdict: Medium Notable software
Source: Google Patents · FreePatentsOnline

The keeper's note

Content generation in immersive environment (Lucasfilm).

Abstract

Views of a virtual environment can be displayed on mobile devices in a real-world environment simultaneously for multiple users. The users can operate selections devices in the real-world environment that interact with objects in the virtual environment. Virtual characters and objects can be moved and manipulated using selection shapes. A graphical interface can be instantiated and rendered as part of the virtual environment. Virtual cameras and screens can also be instantiated to created storyboards, backdrops, and animated sequences of the virtual environment. These immersive experiences with the virtual environment can be used to generate content for users and for feature films.

Background

TECHNICAL FIELD(1) This application discloses technology related to the fields of computer animation, virtual reality environments, and digital content generation. Specifically, this application discloses technology for using a virtual reality environment to pose and animate characters during a pre-visualization phase of a content creation pipeline.BACKGROUND(2) Previsualization, or “previz”, is a method by which complex scenes can be visualized before the creation of digital content. Previsualization has traditionally used still photography, storyboard techniques, and hand sketches to generate a linear sequence of images or scenes that together define a plan for a later sequence of video images. Previsualization allows a director, cinematographer, or visual effects supervisor to not only visualize the way in which a scene may be recorded, but it also allows them to experiment with different staging, lighting, character movements, art direction, camera placement, recording techniques, and so forth. In real-world sets, the director can “walk the set” prior to a video shoot to get a feel for how different aspects of the scene will affect the overall recording. The director may choose to move character or scenery positions, alter lighting, change camera angles, and so forth, during the previsualization stage to minimize the chance of error during the actual filming of the scene.(3) Digital previsualization applies computer animation technology to the traditional previsualization

Claims

1. A method comprising: causing a virtual environment to be displayed on a display of a virtual-reality headset in a real-world environment; receiving first inputs from a selection device to use one or more virtual cameras in the virtual environment; capturing a plurality of images from the one or more virtual cameras in the virtual environment; displaying the plurality of images on a virtual storyboard display in the virtual environment; receiving second inputs from the selection device to select or reorder the plurality of the images on the virtual storyboard display in the virtual environment such that the plurality of images on the virtual storyboard define a scene that is based on the virtual environment; and generating a video sequence based on the plurality of images. | 8. A system comprising: one or more processors; and one or more memories comprising instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising: causing a virtual environment to be displayed on a display of a virtual-reality headset in a real-world environment; receiving first inputs from a selection device to use one or more virtual cameras in the virtual environment; capturing a plurality of images from the one or more virtual cameras in the virtual environment; displaying the plurality of images on a virtual storyboard display in the virtual environment; receiving second inputs from the selection device to select or reorder the plurality of the images on the virtual storyboard display in the virtual environment such that the plurality of images on the virtual storyboard define a scene that is based on the virtual environment; and generating a video sequence based on the plurality of images. | 17. A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising: causing a virtual environment to be displayed on a display of a virtual-reality headset in a real-world environment; receiving first inputs from a selection device to use one or more virtual cameras in the virtual environment; capturing a plurality of images from the one or more virtual cameras in the virtual environment; displaying the plurality of images on a virtual storyboard display in the virtual environment; receiving second inputs from the selection device to select or reorder the plurality of the images on the virtual storyboard display in the virtual environment such that the plurality of images on the virtual storyboard define a scene that is based on the virtual environment; and generating a video sequence based on the plurality of images.