Virtual-scene control device

Number: 9626786
Published: 2017-04-18
Filed: 2010-12-30
Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
Inventors: Reynolds; Spencer et al.
CPC: H04N5/2628; G06T15/205; G06T13/20; G06F3/041; H04N23/60; G06F3/0362; G06F3/0202; H04N23/66; G06F3/04815; G06T7/70; G06T19/003; H04N5/2621; G06T15/20; G06F3/04886; H04N5/2224; G06F3/0346; G11B27/00
Verdict: Medium Hardware
Source: Google Patents · FreePatentsOnline

The keeper's note

Lucasfilm virtual-production control device — a physical controller/camera rig for directing a computer-generated scene.

Abstract

A handheld device includes: an input control configured to control and modify a virtual scene including a virtual camera; and a display that shows a representation of the controlled and modified virtual scene generated by the virtual camera. A system includes: a computer system configured to execute program instructions for generating a virtual scene includinga virtual camera; and handheld device configured to communicate with the computer system for controlling and modifying the virtual scene, the handheld device comprising: an input control configured to control and modify the virtual scene; and a display that shows a representation of the controlled and modified virtual scene generated by the virtual camera.

Background

DESCRIPTION OF DRAWINGS(1) FIG. 1 shows an example of a system with a handheld device for controlling a virtual scene.(2) FIGS. 2A-B, 3A-B, 4A-B, 5A-B, 6A-B and 7A-B show examples of controls on a handheld device.(3) FIG. 8 shows an example of a mode control on a handheld device.(4) FIGS. 9-10 show another example of a handheld device for controlling a virtual scene.(5) FIGS. 11A-B and 12 show other examples of handheld devices for controlling a virtual scene.(6) FIG. 13 is a block diagram of a computing system that can be used in connection with computer-implemented methods described in this document.(7) Like reference symbols in the various drawings indicate like elements.DETAILED DESCRIPTION(8) In some implementations, a virtual set camera controller functions as a director-friendly interaction device foruse with real-time, CGI-driven scenes. While the virtual scene is generated (and possiblymanipulated) from a remote workstation, the camera controller is intended to act as a stand-alone device, allowing the director full control over the scene. Scene interaction willinclude playback controls, timeline manipulation with keying, and asset management. Immediate usage scenarios include pre-visualization scene design and camera blocking, motion capture scene interaction (real-time and/or prerecorded), etc. The device is also designed in a modular sense, such that any (non-critical) sub-component of the device can be added or removed as the user sees fit. These modules can a

Claims

1. A handheld device that allows a user to control a virtual scene generated bya computer system, the virtual scene including one or more characters, a plurality of non-character assets and at least one virtual camera, the plurality of assets including one or more immovable objects, moveable objects or self-propelled objects, the handheld device comprising: a body having a camera form factor including a lens-like portion and a rotatable lens ring coupled to the lens-like portion; an I/O channel configured to enable the handheld device to communicate with the computer system that generates the virtual scene; input controls positioned on the body; a display mounted on the body and configured to show arepresentation of the virtual scene as generated by the at least one virtual camera; and a mode selection input control operable to place the handheld device into a first mode in which the handheld device is configured to enable the user to record images with a virtualcamera of the at least one virtual camera in the virtual scene using the input controls, and a second mode in which the handheld device is configured to enable the user to use theinput controls to select individual ones of the plurality of assets and move the selectedassets within the virtual scene; wherein when the device is in the first mode, the rotatable lens ring can be used by the user to control a zoom level of the virtual camera, and when the device is in the second mode, the user can use the input controls to select between different virtual lenses for the virtual camera. 24. A system comprising: a computer system configured to execute program instructions for generating a virtual scene including one or more characters, a plurality of non-character assets, and at least one virtual camera, the plurality of assets including one or more immovable objects, moveable objects or self-propelled objects that can be recorded within the virtual scene by the at least one virtual camera; and a handheld device configured to communicate with the computer system and allow a user to control and modify the virtual scene and the virtual camera, the handheld device comprising: a body having a camera form factor including a lens-like portion and a rotatable lens ring coupled to the lens-like portion; an I/O channel configured to enable the handheld device to communicate with the computer system; input controls positioned on the body; a display mounted on the body and configured to show a representation of the virtual scene; and a mode selection input control operable to place the handheld device into afirst mode in which the handheld device is configured to enable the user to record imageswith a virtual camera of the at least one virtual camera in the virtual scene using the input controls, and a second mode in which the handheld device is configured to enable the user to use the input controls to select individual ones of the plurality of assets and move the selected assets within the virtual scene; wherein when the device is in the first mode, the rotatable lens ring can be used by the user to control a zoom level of the virtual camera, and when the device is in the second mode, the user can use the input controls to select between different virtual lenses for the virtual camera.