Immersive-environment virtual production object manipulation interaction system.
Views of a virtual environment can be displayed on mobile devices in a real-world environment simultaneously for multiple users. The users can operate selections devices in the real-world environment that interact with objects in the virtual environment. Virtual characters and objects can be moved and manipulated using selection shapes. A graphical interface can be instantiated and rendered as part of the virtual environment. Virtual cameras and screens can also be instantiated to created storyboards, backdrops, and animated sequences of the virtual environment. These immersive experiences with the virtual environment can be used to generate content for users and for feature films.
TECHNICAL FIELD(1) This application discloses technology related to the fields of computer animation, virtual reality environments, and digital content generation. Specifically, this application discloses technology for using a virtual reality environment to pose and animate characters during a pre-visualization phase of a content creation pipeline.BACKGROUND(2) Previsualization, or “previz”, is a method by which complex scenes can be visualized before the creation of digital content. Previsualization has traditionally used still photography, storyboard techniques, and hand sketches to generate a linear sequence of images or scenes that together define a plan for a later sequence of video images. Previsualization allows a director, cinematographer, or visual effects supervisor to not only visualize the way in which a scene may be recorded, but it also allows them to experiment with different staging, lighting, character movements, art direction, camera placement, recording techniques, and so forth. In real-world sets, the director can “walk the set” prior to a video shoot to get a feel for how different aspects of the scene will affect the overall recording. The director may choose to move character or scenery positions, alter lighting, change camera angles, and so forth, during the previsualization stage to minimize the chance of error during the actual filming of the scene.(3) Digital previsualization applies computer animation technology to the traditional previsualization
1. A method comprising: causing a virtual environment to be displayed on a display of a mobile device in a real-world environment, wherein: the virtual environment comprises a virtual character; and the virtual character is associated with a plurality of selection shapes that are displayed with the virtual character in the virtual environment, wherein each selection shape in the plurality of selections shapes comprises a geometric shape that indicates whether the selection shape controls a pose or a location of the virtual character; causing a display of a virtual selection element to move in the virtual environment to correspond to a first movement of a selection device in the real-world environment; determining that the virtual selection element is within a threshold distance of a selection shape in the plurality of selection shapes in the virtual environment; receiving an input to activate the selection shape; and causing the pose or location of the virtual character to change based on the selection shape and a second movement of the selection device in the real-world environment.
8. A system comprising: one or more processors; and one or more memories comprising instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising: causing a virtual environment to be displayed on a display of a mobile device in a real-world environment, wherein: the virtual environment comprises a virtual character; and the virtual character is associated with a plurality of selection shapes that are displayed with the virtual character in the virtual environment, wherein each selection shape in the plurality of selections shapes comprises a geometric shape that indicates whether the selection shape controls a pose or a location of the virtual character; causing a display of a virtual selection element to move in the virtual environment to correspond to a first movement of a selection device in the real-world environment; determining that the virtual selection element is within a threshold distance of a selection shape in the plurality of selection shapes in the virtual environment; receiving an input to activate the selection shape; and causing the pose or location of the virtual character to change based on the selection shape and a second movement of the selection device in the real-world environment.
15. A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising: causing a virtual environment to be displayed on a display of a mobile device in a real-world environment, wherein: the virtual environment comprises a virtual character; and the virtual character is associated with a plurality of selection shapes that are displayed with the virtual character in the virtual environment, wherein each selection shape in the plurality of selections shapes comprises a geometric shape that indicates whether the selection shape controls a pose or a location of the virtual character; causing a display of a virtual selection element to move in the virtual environment to correspond to a first movement of a selection device in the real-world environment; determining that the virtual selection element is within a threshold distance of a selection shape in the plurality of selection shapes in the virtual environment; receiving an input to activate the selection shape; and causing the pose or location of the virtual character to change based on the selection shape and a second movement of the selection device in the real-world environment.