- Number
- 11496691
- Published
- 2022-11-08
- Filed
- 2019-12-16
- Assignee
- Disney Enterprises, Inc.
- Inventors
- Chapman; Steven M., Taylor; Alice, Popp; Joseph
- CPC
- H04N23/90; G06T7/80; H04N23/74
- Verdict
- Low Notable software
- Source
- Google Patents · FreePatentsOnline
The keeper's note
Realistic character illumination rendering technique.
Abstract
A system for illuminating a character for a scene includes a computing platform communicatively coupled to a lighting source and a camera, the computing platform including a hardware processor and a system memory storing a software code. The hardware processor executes the software code to identify a background for the scene, generate, using the lighting source, a simulation of the background on a surface illuminated by the lighting source, and utilize the simulation of the background generated on the surface illuminated by the lighting source to illuminate the character for the scene. The hardware processor also executes the software code to track, using the camera, a plurality of parameters of the camera during recording of an image of the illuminated character and the simulation of the background, and to remove the simulation of the background from the image based on the plurality of parameters of the camera.
Background
BACKGROUND (1) Video content, such as movies and television programming, for example, is widely used to distribute entertainment to consumers. Due to its popularity with those consumers, ever more video is being produced and made available for distribution via traditional broadcast models, as well as streaming services. Consequently, efficient and cost-effective techniques for producing high quality video imagery are increasingly important to the creators and owners of that content. (2) In order to produce realistic scene-based lighting of a performer being filmed, it is important that the performer be illuminated by a close approximation of the lighting that does or will exist in a virtual environment or background in which the performer will be viewed. Because real physical lights are typically needed to illuminate the performer, conventional production techniques may include the inefficient process of manually rotoscoping the stage lighting from the image. An alternative conventional technique is to film the actor on a green matte screen. However, that green screen technique typically offers a poor representation of the environmental lighting effects being reflected from the performer. Although techniques for simulating an entire scene digitally are known, they often produce an “uncanny valley” effect or may simply be too expensive to be a practical alternative. SUMMARY (3) There are provided systems and methods for realistically illuminating a character for a scene, subst
Claims
1. A system for illuminating a character for a scene using a lighting source and a camera, the system comprising: a computing platform communicatively coupled to the lighting source and the camera, the computing platform including a hardware processor and a system memory storing a software code; the hardware processor configured to execute the software code to: identify a background for the scene; generate, using the lighting source, a simulation of the background on a surface illuminated by the lighting source; illuminate the character for the scene utilizing the simulation of the background; track, using the camera, a parameter of the camera during a recording by the camera of an image of the illuminated character and the simulation of the background, wherein the parameter of the camera includes a lens characteristic of the camera, a yaw of the camera, a pitch of the camera or a roll of the camera; and remove the simulation of the background from the image based on the parameter of the camera. ||
10. A system for illuminating a character for a scene using a lighting source and a camera, the system comprising: a computing platform communicatively coupled to the lighting source and the camera, the computing platform including a hardware processor and a system memory storing a software code; the hardware processor configured to execute the software code to: identify a background for the scene; generate, using the lighting source, a simulation of the background on a surface illuminated by the lighting source; illuminate the character for the scene utilizing the simulation of the background; track, using the camera, a parameter of the camera during a recording by the camera of an image of the illuminated character and the simulation of the background; and remove the simulation of the background from the image by: building a pose model of the camera using the parameter of the camera; correlating the pose model with the image to determine a hypothetical representation of the image without the character being present in combination with the background; and digitally removing pixel data from the image in pixel locations where the hypothetical representation and the image correspond, thereby leaving the illuminated character. ||
11. A method for use by a system for illuminating a character for a scene, the system including a lighting source, a camera, and a computing platform communicatively coupled to the lighting source and the camera, the computing platform including a hardware processor and a system memory storing a software code, the method comprising: identifying, by the software code executed by the hardware processor, a background for the scene; generating, by the software code executed by the hardware processor and using the lighting source, a simulation of the background on a surface illuminated by the lighting source; illuminating, by the software code executed by the hardware processor, the character for the scene utilizing the simulation of the background; tracking, by the software code executed by the hardware processor and using the camera, a parameter of the camera during a recording by the camera of an image of the illuminated character and the simulation of the background by the camera, wherein the parameter of the camera includes a lens characteristic of the camera, a yaw of the camera, a pitch of the camera or a roll of the camera; and removing, by the software code executed by the hardware processor, the simulation of the background from the image based on the parameter of the camera. ||
20. A method for use by a system for illuminating a character for a scene, the system including a lighting source, a camera, and a computing platform communicatively coupled to the lighting source and the camera, the computing platform including a hardware processor and a system memory storing a software code, the method comprising: identifying, by the software code executed by the hardware processor, a background for the scene; generating, by the software code executed by the hardware processor and using the lighting source, a simulation of the background on a surface illuminated by the lighting source; illuminating, by the software code executed by the hardware processor, the character for the scene utilizing the simulation of the background; tracking, by the software code executed by the hardware processor and using the camera, a parameter of the camera during a recording by the camera of an image of the illuminated character and the simulation of the background by the camera; and removing, by the software code executed by the hardware processor, the simulation of the background from the image by: building a pose model of the camera using the parameter of the camera; correlating the pose model with the image to determine a hypothetical representation of the image without the character being present in combination with the background; and digitally removing pixel data from the image in pixel locations where the hypothetical representation and the image correspond, thereby leaving the illuminated character.