TECHNIQUES FOR DENOISING VIDEOS

Number: 20260320758
Published: 2026-10-15
Filed: 2026-06-22
Assignee: DISNEY ENTERPRISES, INC.
Inventors: ZHANG; Yang, AYDIN; Tunc Ozan, SCHROERS; Christopher Richard
CPC: G06T5/70; G06N20/00; G06T5/73; G06T2207/20081
Verdict: Set aside dropped in weekly review
In edition: 2026-W42
Source: Google Patents · FreePatentsOnline

The keeper's note

Techniques are disclosed for denoising videos.

Abstract

Techniques are disclosed for denoising videos. In some embodiments, video frames are denoised using a denoising model that includes an encoder-decoder architecture and attention modules. During training of the denoising model, the attention modules learn weightings to upweight certain dimensions of input features to help pixel registration, remove ghosting artifacts, and improve temporal consistency when the frames of a video are being denoised. The denoising model can also be used to train a student denoising model that has a same architecture as, but is smaller and faster than, the denoising model. After training, noisy video frames can be input into the denoising model and/or the student denoising model to generate corresponding denoised video frames.

Background

BACKGROUND Technical Field

Embodiments of the present disclosure relate generally to computer science and video processing and, more specifically, to techniques for denoising videos. Description of the Related Art

Image noise refers to random variation in the color and/or brightness within images. Examples of images include standalone images and the frames of a video. Images captured by cameras can contain noise due to the mechanics of camera sensors. For example, the quality of images captured in low-lighting conditions can be adversely affected by noise. Noise can also be a byproduct in images that are rendered using Monte Carlo rendering techniques.

Image denoising is the process of removing noise from an image. Conventional approaches for image denoising can introduce unwanted artifacts into denoised images. For example, when the frames of a video are denoised according to conventional approaches, the denoised frames can have temporally inconsistent denoised regions that vary from frame to frame, even when no such variations should occur. As another example, noise and texture can “drag” from one denoised frame to another denoised frame, producing a ghost-like effect. Such artifacts that are introduced during the denoising process greatly reduce the quality of the generated denoised images.

In addition, conventional approaches for image denoising require a user to have extensive knowledge of the noise characteristics within each noisy image in o

Claims

1. A computer-implemented method for generating a denoising model, the method comprising: determining (i) one or more sets of noisy frames and (ii) one or more sets of reference frames corresponding to the one or more sets of noisy frames; inputting the one or more sets of noisy frames into (i) a first denoising model and (ii) a second denoising model that is smaller than the first denoising model; computing a feature loss based on (i) a first set of features generated by the first denoising model from the one or more sets of noisy frames and (ii) a second set of features generated by the second denoising model from the one or more sets of noisy frames; and training the second denoising model using the feature loss. || 11. One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of: determining (i) one or more sets of noisy frames and (ii) one or more sets of reference frames corresponding to the one or more sets of noisy frames; inputting the one or more sets of noisy frames into (i) a first denoising model and (ii) a second denoising model that is smaller than the first denoising model; computing a feature loss based on (i) a first set of features generated by the first denoising model from the one or more sets of noisy frames and (ii) a second set of features generated by the second denoising model from the one or more sets of noisy frames; and training the second denoising model using the feature loss. || 20. A system, comprising: one or more memories that store instructions, and one or more processors that are coupled to the one or more memories and, when executing the instructions, are configured to perform the steps of: determining (i) one or more sets of noisy frames and (ii) one or more sets of reference frames corresponding to the one or more sets of noisy frames; inputting the one or more sets of noisy frames into (i) a first denoising model and (ii) a second denoising model that is smaller than the first denoising model; computing a reconstruction loss based on (i) one or more sets of denoised frames generated by the second denoising model from the one or more sets of noisy frames and (ii) one or more additional sets of denoised frames generated by the first denoising model from the one or more sets of noisy frames; and training the second denoising model using the reconstruction loss.