- Number
- 9710972
- Published
- 2017-07-18
- Filed
- 2014-09-11
- Assignee
- LUCASFILM ENTERTAINMENT COMPANY LTD.
- Inventors
- Sanders; Mike, Libreri; Kim, Rasmussen; Nick, Gaeta; John
- CPC
- H04N5/275; H04N5/265; G06T19/006
- Verdict
- Medium Hardware
- Source
- Google Patents · FreePatentsOnline
The keeper's note
An immersion photography system with a dynamic matte screen that displays a 3D virtual scene from a subjects perspective for real-time on-set compositing.
Abstract
A method may include displaying, on one or more display devices in a virtual-reality environment, a visual representation of a 3-D virtual scene from the perspective of a subject location in the virtual-reality environment. The method may also include displaying, on the oneor more display devices, a chroma-key background with the visual representation. The method may further include recording, using a camera, an image of the subject in the virtual-reality environment against the chroma-key background.
Background
BRIEF DESCRIPTION OF THE DRAWINGS(1) A further understanding of the nature and advantages of the present invention may be realized by reference to the remaining portions of the specification and the drawings, wherein like reference numerals are used throughout the several drawings to refer to similar components. In some instances, a sub-label is associated with a reference numeral to denote one of multiple similar components. When reference is made to a reference numeral without specification to an existing sub-label, it is intended to refer to all suchmultiple similar components.(2) FIG. 1A illustrates a subject in a virtual-reality environment, according to some embodiments.(3) FIG. 1B illustrates a subject inserted into a 3-Dvirtual scene, according to some embodiments.(4) FIG. 2 illustrates a subject in a virtual-reality environment with elements of a 3-D virtual scene projected onto one or more display devices, according to some embodiments.(5) FIG. 3 illustrates a dynamic chroma-key background displayed in the virtual-reality environment, according to some embodiments.(6) FIG. 4 illustrates a 2-D camera perspective of an image of the subject in the virtual-reality environment captured against the chroma-key background, according to some embodiments.(7) FIG. 5 illustrates chroma-key background image sequences that are synced to the camera frame rate, according to some embodiments.(8) FIG. 6A illustrates a chroma-key background with a subject at a first position, accord
Claims
1. A method comprising: generating, for display on one or more display devices in a virtual-reality environment, animage comprising a visual representation of a 3-D virtual scene rendered from the perspective of a subject located in the virtual-reality environment; modifying the image to further comprise a chroma-key background inserted into the visual representation of the 3-D virtual scene, wherein the chroma-key background is positioned in the image such that when the image is displayed on the one or more display devices, the subject is seen against the chroma-key background from the view of a camera recording the subject; displaying, on the one or more display devices, the image comprising the visual representation of the 3-D virtual scene with the chroma-key background inserted, such that the chroma-key background is visible on the one or more display devices; and recording, using the camera, an image of the subject in the virtual-reality environment against the chroma-key background along withat least a portion of the one or more display devices.
12. A system comprising: a virtual-reality environment comprising one or more display devices; a camera; and a computer system comprising one or more processors and a memory device having instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to perform operations comprising: generating, for display on the one or more display devices in the virtual-reality environment, an image comprising a visual representation of a 3-D virtual scene rendered from the perspective of a subject located in the virtual-reality environment; modifying the image to further comprise a chroma-key background inserted into the visual representation of the 3-D virtual scene, wherein the chroma-key background is positioned in the image such that when the image is displayed on the one or more display devices, the subject is seen against the chroma-key background from the view of a camera recording the subject; displaying, on the one or more display devices, the image comprising thevisual representation of the 3-D virtual scene with the chroma-key background inserted, such that the chroma-key background is visible on the one or more display devices; and recording, using the camera, an image of the subject in the virtual-reality environment against the chroma-key background along with at least a portion of the one or more display devices.
19. A non-transitory storage medium comprising instructions which, when executed by one or more processors, cause the one or more processors to perform operations comprising: generating, for display on one or more display devices in a virtual-reality environment, animage comprising a visual representation of a 3-D virtual scene rendered from the perspective of a subject located in the virtual-reality environment; modifying the image to further comprise a chroma-key background inserted into the visual representation of the 3-D virtual scene, wherein the chroma-key background is positioned in the image such that when the image is displayed on the one or more display devices, the subject is seen against the chroma-key background from the view of a camera recording the subject; displaying, on the one or more display devices, the image comprising the visual representation of the 3-D virtual scene with the chroma-key background inserted, such that the chroma-key background is visible on the one or more display devices; and recording, using the camera, an image of the subject in the virtual-reality environment against the chroma-key background along withat least a portion of the one or more display devices.