Outer Rim Archives
Archives · 2024 · 11887251

Granted patent

System and techniques for patch color correction for an immersive content production system

Number
11887251
Published
2024-01-30
Filed
2022-04-08
Assignee
LUCASFILM ENTERTAINMENT COMPANY LTD.
Inventors
Jutan; Michael et al.
CPC
G09G3/2003; H04N23/62; G06T15/50; G09G3/002; G06T19/006; G06T19/003; G06F3/147; G06T15/20; G06T11/00; G09G3/32; G09G3/003
Verdict
Low Hardware
Source
Google Patents · FreePatentsOnline

The keeper's note

Virtual-production immersive-display color-correction system (granted).

Abstract

A computing device in communication with an immersive content generation system can generate and present images of a virtual environment on one or more light-emitting diode (LED) displays at least partially surrounding a performance area. The device may capture a plurality of images of a performer or a physical object in the performance area along with at least some portion of the images of the virtual environment by a taking camera. The device may identify a color mismatch between a portion of the performer or the physical object and a virtual image of the performer or the physical object in the images of the virtual environment. The device may generate a patch for the images of the virtual environment to correct the color mismatch. The device may insert the patch into the images of the virtual environment. Also, the device may generate content based on the plurality of captured images.

Background

(1) This application is related to concurrently filed U.S. Non-provisional application Ser. No. 17/716,333, entitled “Color and Lighting Adjustment for Immersive Content Production Systems” by Jutan et al., which is incorporated herein by reference. This application is related to concurrently filed U.S. Non-provisional application Ser. No. 17/716,384, entitled “Color and Lighting Adjustment for Immersive Content Production Systems” by Hirschfield et al., which is incorporated herein by reference. This application is related to concurrently filed U.S. Non-provisional application Ser. No. 17/716,474, entitled “Color and Lighting Adjustment for Immersive Content Production Systems” by Jutan et al., which is incorporated herein by reference. FIELD (2) The present disclosure generally relates to generating content using one or more displays configured for operation in an immersive content production system. In some embodiments, the images shown on the displays may be color corrected in real-time or at interactive frame rates. In addition, virtual lights can be generated using the interactive displays. BACKGROUND (3) One method of creating a virtual reality experience can include surrounding a user with large display screens that present a virtual environment for the user. For example, an immersive content production system that can be used in production of movies and videos can include a stage or performance area that is at least partially enclosed with one or more walls and/or a

Claims

1. A computer-implemented method of generating content, the method comprising: generating and displaying images of a virtual environment on one or more light-emitting diode (LED) displays at least partially surrounding a performance area; capturing, by a taking camera, a plurality of images of a performer or a physical object in the performance area, wherein the performer or the physical object is in a foreground of the plurality of captured images and at least a portion of the performer or the physical object is displayed in images of the virtual environment in a background of the plurality of captured images; receiving one or more inputs identifying a color mismatch between the performer or the physical object in the foreground and the portion of the performer or the physical object displayed in the images of the virtual environment in the background; generating a patch for the images of the virtual environment to correct the color mismatch; inserting the patch into the images of the virtual environment displayed on the one or more light-emitting diode (LED) displays; and generating content based on the plurality of captured images. || 8. A non-transitory computer-readable medium storing a set of instructions, the set of instructions comprising: one or more instructions that, when executed by one or more processors of a computing device, cause the computing device to: generate and display images of a virtual environment on one or more light-emitting diode (LED) displays at least partially surrounding a performance area; capture, by a taking camera, a plurality of images of a performer or a physical object in the performance area, wherein the performer or the physical object is in a foreground of the plurality of captured images and at least a portion of the performer or the physical object is displayed in images of the virtual environment in a background of the plurality of captured images; receive one or more inputs that identify a color mismatch between the performer or the physical object in the foreground and the portion of the performer or the physical object displayed in the images of the virtual environment in the background; generate a patch for the images of the virtual environment to correct the color mismatch; insert the patch into the images of the virtual environment displayed on the one or more LED displays; and generate content based on the plurality of captured images. || 15. An immersive content generation system, comprising: one or more memories; and one or more processors, communicatively coupled to the one or more memories, configured to: generate and display images of a virtual environment on one or more light-emitting diode (LED) displays at least partially surrounding a performance area; capture, by a taking camera, a plurality of images of a performer or a physical object in the performance area, wherein the performer or the physical object is in a foreground of the plurality of captured images and at least a portion of the performer or the physical object is displayed in images of the virtual environment in a background of the plurality of captured images; receive one or more inputs that identify a color mismatch between the performer or the physical object in the foreground and the portion of the performer or the physical object displayed in the images of the virtual environment in the background; generate a patch for the images of the virtual environment to correct the color mismatch; insert the patch into the images of the virtual environment displayed on the one or more LED displays; and generate content based on the plurality of captured images.