Color correction technique for virtual-production immersive systems.
In at least one embodiment, an immersive content generation system may receive a first user input that defines a three-dimensional (3D) volume within a performance area. In at least one embodiment, the system may capture a plurality of images of an object in the performance area using a camera, wherein the object is at least partially surrounded by one or more displays presenting images of a virtual environment. In at least one embodiment, the system may receive a second user input to adjust a color value of a virtual image of the object as displayed in the images in the virtual environment. In at least one embodiment, the system may perform a color correction pass for the displayed images of the virtual environment. In at least one embodiment, the system may generate content based on the plurality of captured images that are corrected via the color correction pass.
FIELD (1) The present disclosure generally relates to generating content using one or more displays configured for operation in an immersive content production system. In some embodiments, the images shown on the displays may be color corrected in real-time or at interactive frame rates. The images may also have appropriate motion blur and depth of field applied. BACKGROUND (2) Immersive content systems allow for capturing the performance of actors in a performance area using one or more cameras. The performance area can be at least partially enclosed with one or more walls and ceiling of display screens. The scene can include both live actors and props and virtual elements (e.g., a virtual sun or street lamp) displayed on the one or more displays. (3) In some instances, the colors of virtual objects on a display of the immersive cave or walls may not match or may become unsynchronized with the real world colors of the actors and physical objects within the performance area. This could be a result of changing lighting patterns, light from the displays illuminating the actors, etc. As a result, content generated from images captured by the taking camera may not appear realistic to viewers due to color discrepancies between the virtual and physical objects. (4) In some instances, effects can be employed to give the perception of motion of an object on stage. For example, a vehicle can be on the stage and techniques can be employed to give the viewer a perception that the vehicl
1. A computer-implemented method of generating content, the method comprising: receiving a first user input that defines a three-dimensional volume within a performance area; capturing a plurality of images of a physical object in the three-dimensional volume within the performance area using a camera, wherein the physical object is at least partially surrounded by one or more displays presenting images of a virtual environment; identifying a color mismatch between the physical object and a virtual image of the physical object in the virtual environment; performing a color correction pass for the images of the virtual environment, wherein the color correction pass includes: determining one or more color error values between the physical object in the performance area and the virtual image in the virtual environment; iteratively modifying one or more color values for the virtual image until the one or more color error values meet one or more threshold color correction values; and generating the content based on the plurality of captured images that are corrected via the color correction pass. ||
8. An immersive content generation system, comprising: one or more memories storing instructions; and one or more processors communicatively coupled to the one or more memories that execute the instructions to perform operations comprising: receiving a first user input that defines a three-dimensional volume within a performance area; capturing a plurality of images of a physical object in the three-dimensional volume within the performance area using a camera, wherein the physical object is at least partially surrounded by one or more displays presenting images of a virtual environment; identifying a color mismatch between the physical object and a virtual image of the physical object in the virtual environment; performing a color correction pass for the images of the virtual environment, wherein the color correction pass includes: determining one or more color error values between the physical object in the performance area and the virtual image in the virtual environment; iteratively modifying one or more color values for the virtual image until the one or more color error values meet one or more threshold color correction values; and generating content based on the plurality of captured images that are corrected via the color correction pass. ||
15. A non-transitory computer-readable medium storing instructions, that when executed by one or more processors, cause the one or more processors to perform operations comprising: receiving a first user input that defines a three-dimensional volume within a performance area; capturing a plurality of images of a physical object in the three-dimensional volume within the performance area using a camera, wherein the physical object is at least partially surrounded by one or more displays presenting images of a virtual environment; identifying a color mismatch between the physical object and a virtual image of the physical object in the virtual environment performing a color correction pass for the images of the virtual environment, wherein the color correction pass includes: determining one or more color error values between the physical object in the performance area and the virtual image in the virtual environment; iteratively modifying one or more color values for the virtual image until the one or more color error values meet one or more threshold color correction values; and generating content based on the plurality of captured images that are corrected via the color correction pass.