Motion blur/depth-of-field rendering technique for virtual production.
An immersive content production system may capture a plurality of images of a physical object in a performance area using a taking camera. The system may determine an orientation and a velocity of the taking camera with respect to the physical object in the performance area. A user may select a first amount of motion blur exhibited by the images of the physical object based on a desired motion effects. The system may determine a correction to apply to a virtual object based at least in part on the orientation and the velocity of the taking camera and the desired motion blur effect. The system may also detect the distance from the taking camera to a physical object and the taking camera to the virtual display. The system may use these distances to generate a corrected circle of confusion for the virtual images on the display.
FIELD (1) The present disclosure generally relates to generating content using one or more displays configured for operation in an immersive content production system. In some embodiments, the images shown on the displays may be color corrected in real-time or at interactive frame rates. The images may also have appropriate motion blur and depth of field applied. BACKGROUND (2) Immersive content systems allow for capturing the performance of actors in a performance area using one or more cameras. The performance area can be at least partially enclosed with one or more walls and ceiling of display screens. The scene can include both live actors and props and virtual elements (e.g., a virtual sun or street lamp) displayed on the one or more displays. (3) In some instances, the colors of virtual objects on a display of the immersive cave or walls may not match or may become unsynchronized with the real world colors of the actors and physical objects within the performance area. This could be a result of changing lighting patterns, light from the displays illuminating the actors, etc. As a result, content generated from images captured by the taking camera may not appear realistic to viewers due to color discrepancies between the virtual and physical objects. (4) In some instances, effects can be employed to give the perception of motion of an object on stage. For example, a vehicle can be on the stage and techniques can be employed to give the viewer a perception that the vehicl
1. A computer-implemented method of generating content, the method comprising: capturing a plurality of images of a physical object in a performance area using a taking camera, wherein the physical object is at least partially surrounded by one or more displays presenting images of a virtual environment; determining an orientation and a velocity of the taking camera with respect to the physical object in the performance area; receiving an input regarding a desired motion effect for the physical object; calculating an amount of motion blur to apply to a virtual object in the virtual environment based at least in part on the desired motion effect and the orientation and velocity of the taking camera, wherein the calculated amount of motion blur corrects for blur caused by the orientation and the velocity of the taking camera; applying the amount of motion blur to the virtual object in the virtual environment; and generating content based on the plurality of captured images and the amount of motion blur. ||
8. A immersive content generation system, comprising: one or more memories storing instructions; and one or more processors communicatively coupled to the one or more memories, that execute the instructions to perform operations comprising: capturing a plurality of images of a physical object in a performance area using a taking camera, wherein the physical object is at least partially surrounded by one or more displays presenting images of a virtual environment; determining an orientation and a velocity of the taking camera with respect to the physical object in the performance area; receiving an input regarding a desired motion effect for the physical object; calculating an amount of motion blur to apply to a virtual object in the virtual environment based at least in part on the desired motion effect and the orientation and velocity of the taking camera, wherein the calculated amount of motion blur corrects for blur caused by the orientation and the velocity of the taking camera; applying the amount of motion blur to the virtual object in the virtual environment; and generating content based on the plurality of captured images and the amount of motion blur. ||
14. A non-transitory computer-readable medium storing instructions, that when executed by one or more processors, cause the one or more processors to perform operations comprising: capturing a plurality of images of a physical object in a performance area using a taking camera, wherein the physical object is at least partially surrounded by one or more displays presenting images of a virtual environment; determining an orientation and a velocity of the taking camera with respect to the physical object in the performance area; receiving an input regarding a desired motion effect for the physical object; calculating an amount of motion blur to apply to a virtual object in the virtual environment based at least in part on the desired motion effect and the orientation and velocity of the taking camera, wherein the calculated amount of motion blur corrects for blur caused by the orientation and the velocity of the taking camera; applying the amount of motion blur to the virtual object in the virtual environment; and generating content based on the plurality of captured images and the amount of motion blur.