Outer Rim Archives
Archives · 2025 · 12361634

Granted patent

Techniques for improved lighting models for appearance capture

Number
12361634
Published
2025-07-15
Filed
2022-12-14
Assignee
DISNEY ENTERPRISES, INC.
Inventors
Urnau Gotardo; Paulo Fabiano et al.
CPC
G06T7/0012; G06T15/506; H04N13/111; G06T15/06; H04N13/254; G06T15/04; H04N13/243
Verdict
Low Notable software
Source
Google Patents · FreePatentsOnline

The keeper's note

Improved lighting-model appearance-capture rendering technique (continuation).

Abstract

Various embodiments include a system for rendering an object, such as human skin or a human head, from captured appearance data. The system includes a processor executing a near field lighting reconstruction module. The system determines at least one of a three-dimensional (3D) position or a 3D orientation of a lighting unit based on a plurality of captured images of a mirror sphere. For each point light source in a plurality of point light sources included in the lighting unit, the system determines an intensity associated with the point light source. The system determines captures appearance data of the object, where the object is illuminated by the lighting unit. The system renders an image of the object based on the appearance data and the intensities associated with each point light source in the plurality of point light sources.

Background

BACKGROUND Field of the Various Embodiments (1) Various embodiments relate generally to appearance capture systems and, more specifically, to techniques for improved lighting models for appearance capture. Description of the Related Art (2) One aspect of rendering realistic human faces is to capture the appearance of the skin, which has a complex multi-layer structure with combined surface and subsurface reflectance properties. Appearance capture techniques estimate geometry and reflectance properties of various objects (such as a human head, facial skin, and/or the like) by performing a computationally intensive inverse rendering optimization in which one or more images are re-rendered a large number of times and compared to real images captured by multiple cameras at various positions and orientations. While state-of-the-art appearance capture techniques have achieved impressive results, such techniques often make simplifying assumptions that do not always hold in reality, even though these simplifying assumptions help to reduce computational complexity and rendering time. (3) One such simplifying assumption is that light sources are often modeled as a collection of point light sources (referred to as an environment map) that are distant from the face. The light rays from each of these light sources are, therefore, assumed to strike all points on the face at the same incident angle (direction). Further, the directional distribution of incoming light is assumed to be spatial

Claims

1. A computer-implemented method for rendering an object from captured appearance data, the method comprising: determining at least one of a three-dimensional (3D) position or a 3D orientation of a lighting unit based on a plurality of captured images of a mirror sphere; for each point light source in a plurality of point light sources included in the lighting unit, determining an intensity associated with the point light source; capturing appearance data of the object, where the object is illuminated by the lighting unit; and rendering an image of the object based on the appearance data and the intensities associated with each point light source in the plurality of point light sources. || 12. One or more non-transitory computer-readable media storing program instructions that, when executed by one or more processors, cause the one or more processors to perform steps of: determining at least one of a three-dimensional (3D) position or a 3D orientation of a lighting unit based on a plurality of captured images of a mirror sphere; for each point light source in a plurality of point light sources included in the lighting unit, determining an intensity associated with the point light source; capturing appearance data of an object, where the object is illuminated by the lighting unit; and rendering an image of the object based on the appearance data and the intensities associated with each point light source in the plurality of point light sources. || 20. A system, comprising: one or more memories storing instructions; and one or more processors coupled to the one or more memories and, when executing the instructions: determine at least one of a three-dimensional (3D) position or a 3D orientation of a lighting unit based on a plurality of captured images of a mirror sphere; for each point light source in a plurality of point light sources included in the lighting unit, determine an intensity associated with the point light source; capture appearance data of an object, where the object is illuminated by the lighting unit; and render an image of the object based on the appearance data and the intensities associated with each point light source in the plurality of point light sources.