Application (pre-grant publication)
APPEARANCE CAPTURE UNDER MULTIPLE LIGHTING CONDITIONS
- Number
- 20250014267
- Published
- 2025-01-09
- Filed
- 2024-09-09
- Assignee
- DISNEY ENTERPRISES, INC.
- Inventors
- URNAU GOTARDO; Paulo Fabiano et al.
- CPC
- G01N21/55; G06V10/60; G06V20/64; G06V10/16; G06T15/205; G06T15/50; G06V40/16
- Verdict
- Low Notable software
- Source
- Google Patents · FreePatentsOnline
The keeper's note
Multi-lighting-condition appearance-capture technique.
Abstract
One embodiment of the present invention sets forth a technique for performing appearance capture. The technique includes receiving a first sequence of images of an object, wherein the first sequence of images includes a first set of images interleaved with a second set of images, and wherein the first set of images is captured based on illumination of the object using a first lighting pattern and the second set of images is captured based on illumination of the object using one or more lighting patterns that are different from the first lighting pattern. The technique also includes generating a first set of appearance parameters associated with the object based on a first inverse rendering associated with the first sequence of images.
Background
BACKGROUND Field of the Various Embodiments
Embodiments of the present disclosure relate generally to computer science and computer graphics and, more specifically, to techniques for appearance capture under multiple lighting conditions. Description of the Related Art
Realistic digital faces are required for various computer graphics and computer vision applications. For example, digital faces are oftentimes used in virtual scenes of film or television productions and in video games.
A digital face can be synthesized using three-dimensional (3D) geometry of the face and two-dimensional (2D) appearance maps indicating reflectance properties of the face. As used herein, “appearance” refers to reflectance properties characterizing how light interacts with materials before reaching a camera. Example reflectance properties include, without limitation, shininess (also referred to as “specular intensity”) and the shape of a specular reflection lobe (also referred to as “roughness”), which are surface properties of skin models, as well as shading-free color (also referred to as “diffuse albedo”), which is mostly a subsurface property but can include contributions from the surface of skin as well. The reflectance properties of human skin, and more particularly the skin on a face, can vary due to skin type, tanning, blood flow caused by muscle activation or physiological effects, scarring, stretching, oiliness, and sweating, among other things.
Facial captur