COLOR AND LIGHTING ADJUSTMENT FOR IMMERSIVE CONTENT PRODUCTION SYSTEM

Number: 20220343591
Published: 2022-10-27
Filed: 2022-04-08
Assignee: LUCASFILM ENTERNTAINMENT COMPANY LTD.
Inventors: Jutan; Michael, Hirschfield; David, Bucior; Alan
CPC: G06T15/50; G06T19/003; H04N23/62; G09G3/002; G06T19/006; G06T11/00; G09G3/003; G06F3/147; G06T15/20; G09G3/2003; G09G3/32
Verdict: Low Hardware
Source: Google Patents · FreePatentsOnline

The keeper's note

Immersive virtual-production color/lighting-adjustment hardware/system.

Abstract

A computing device in communication with an immersive content generation system can generate and present images of a virtual environment on one or more light-emitting diode (LED) displays at least partially surrounding a performance area. The device may capture a plurality of images of a performer or a physical object in the performance area along with at least some portion of the images of the virtual environment by a taking camera. The device may identify a color mismatch between a portion of the performer or the physical object and a virtual image of the performer or the physical object in the images of the virtual environment. The device may generate a patch for the images of the virtual environment to correct the color mismatch. The device may insert the patch into the images of the virtual environment. Also, the device may generate content based on the plurality of captured images.

Background

FIELD

The present disclosure generally relates to generating content using one or more displays configured for operation in an immersive content production system. In some embodiments, the images shown on the displays may be color corrected in real-time or at interactive frame rates. In addition, virtual lights can be generated using the interactive displays. BACKGROUND

One method of creating a virtual reality experience can include surrounding a user with large display screens that present a virtual environment for the user. For example, an immersive content production system that can be used in production of movies and videos can include a stage or performance area that is at least partially enclosed with one or more walls and/or a ceiling each of which can be covered with display screens. One or more cameras can be placed in the performance area and live actors can interact with physical props placed on the stage, as well as with virtual elements displayed on the displays. Such immersive content production systems can present challenges. SUMMARY

A system of one or more computers can be configured to perform particular operations or actions by virtue of having software, firmware, hardware, or a combination of them installed on the system that in operation causes or cause the system to perform the actions. One or more computer programs can be configured to perform particular operations or actions by virtue of including instructions that, when executed by

Claims

1. A computer-implemented method of generating content, the method comprising: generating and presenting images of a virtual environment on one or more light-emitting diode (LED) displays at least partially surrounding a performance area; capturing a plurality of images of a performer or a physical object in the performance area along with at least some portion of the images of the virtual environment by a taking camera; identifying a color mismatch between a portion of the performer or the physical object and a virtual image of the performer or the physical object in the images of the virtual environment; generating a patch for the images of the virtual environment to correct the color mismatch; inserting the patch into the images of the virtual environment; and generating content based on the plurality of captured images. || 8. A non-transitory computer-readable medium storing a set of instructions, the set of instructions comprising: one or more instructions that, when executed by one or more processors of a computing device, cause the computing device to: generate and presenting images of a virtual environment on one or more light-emitting diode (LED) displays at least partially surrounding a performance area; capture a plurality of images of a performer or a physical object in the performance area along with at least some portion of the images of the virtual environment by a taking camera; identify a color mismatch between a portion of the performer or the physical object and a virtual image of the performer or the physical object in the images of the virtual environment; generate a patch for the images of the virtual environment to correct the color mismatch; insert the patch into the images of the virtual environment; and generate content based on the plurality of captured images. || 15. An immersive content generation system, comprising: one or more memories; and one or more processors, communicatively coupled to the one or more memories, configured to: generate and presenting images of a virtual environment on one or more light-emitting diode (LED) displays at least partially surrounding a performance area; capture a plurality of images of a performer or a physical object in the performance area along with at least some portion of the images of the virtual environment by a taking camera; identify a color mismatch between a portion of the performer or the physical object and a virtual image of the performer or the physical object in the images of the virtual environment; generate a patch for the images of the virtual environment to correct the color mismatch; insert the patch into the images of the virtual environment; and generate content based on the plurality of captured images.