PATH GUIDING USING NEURAL RADIANCE CACHING WITH RESAMPLED IMPORTANCE SAMPLING

Number: 20250209726
Published: 2025-06-26
Filed: 2024-12-20
Assignee: DISNEY ENTERPRISES, INC.
Inventors: SALEHI; Farnood, PAPAS; Marios, PORTENIER; Tiziano, MANZI; Marco, HADADAN; Saeed
CPC: G06T15/06; G06T15/005; G06T15/506; G06T1/60
Verdict: Low Notable software
Source: Google Patents · FreePatentsOnline

The keeper's note

Neural radiance-caching path-guiding rendering technique.

Abstract

The present invention sets forth techniques for performing path guiding. The techniques include receiving a representation of a three-dimensional (3D) scene and a virtual camera location and generating a lightpath that originates at the virtual camera location and reaches a point included in the 3D scene. The techniques also include selecting, from a set of candidate directions, a direction in which to extend the generated lightpath from the point, wherein the selecting is based at least on one or estimates of incident light characteristics associated with the 3D scene predicted by a machine learning model. The techniques further include extending the generated lightpath in the selected direction and generating a two-dimensional (2D) rendering of the 3D scene, based at least on the generated lightpath.

Background

BACKGROUND Field of the Various Embodiments

Embodiments of the present disclosure relate generally to computer graphics and, more specifically, to techniques for performing path guiding using neural radiance caching with resampled importance sampling. DESCRIPTION OF THE RELATED ART

In the field of computer graphics, rendering includes the process of generating an image of a scene based on a two-dimensional (2D) or three-dimensional (3D) representation of the scene. The 2D or 3D representation of the scene may include geometry, texture, lighting, and/or shading information describing the scene. In particular, the 2D or 3D representation may include information describing one or more light sources included in the scene.

One technique for calculating lighting effects in a rendered image of a scene includes generating multiple lightpaths associated with a virtual camera viewpoint. Each lightpath describes a trajectory that potentially connects the virtual camera to a light source included in the scene, and may include multiple scattering events or bounces based on the location of the virtual camera, the location of the one or more light sources, and the positions and surface characteristics associated with one or more objects included in the scene. Each interaction between a lightpath and one or more surfaces included in the scene may change the direction, color, and/or intensity of the reflected or scattered light and provided visual information associated w

Claims

1. A computer-implemented method for performing path guiding, the computer-implemented method comprising: receiving a representation of a three-dimensional (3D) scene and a virtual camera location; generating a lightpath that originates at the virtual camera location and reaches a point included in the 3D scene; selecting, from a set of candidate directions, a direction in which to extend the generated lightpath from the point, wherein the selecting is based at least on one or estimates of incident light characteristics associated with the 3D scene and predicted by a machine learning model; extending the generated lightpath in the selected direction; and generating a two-dimensional (2D) rendering of the 3D scene based at least on the generated lightpath. || 10. One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of: receiving a representation of a three-dimensional (3D) scene and a virtual camera location; generating a lightpath that originates at the virtual camera location and reaches a point included in the 3D scene; selecting, from a set of candidate directions, a direction in which to extend the generated lightpath from the point, wherein the selecting is based at least on one or estimates of incident light characteristics associated with the 3D scene and predicted by a machine learning model; extending the generated lightpath in the selected direction; and generating a two-dimensional (2D) rendering of the 3D scene based at least on the generated lightpath. || 19. A system comprising: one or more memories storing instructions; and one or more processors for executing the instructions to: receive a representation of a three-dimensional (3D) scene and a virtual camera location; generate a lightpath that originates at the virtual camera location and reaches a point included in the 3D scene; select, from a set of candidate directions, a direction in which to extend the generated lightpath from the point, wherein the selecting is based at least on one or estimates of incident light characteristics associated with the 3D scene and predicted by a machine learning model; extend the generated lightpath in the selected direction; and generate a two-dimensional (2D) rendering of the 3D scene based at least on the generated lightpath.