FILM GRAIN MEASUREMENT BASED ON SUBBAND ANALYSIS IN FREQUENCY DOMAIN

Number: 20250117909
Published: 2025-04-10
Filed: 2024-09-18
Assignee: Disney Enterprises, Inc.
Inventors: Meng; Xuewei et al.
CPC: G06T5/70; G06T5/50; G06T5/10; G06T7/0002
Verdict: Set aside film grain analysis, plumbing
Source: Google Patents · FreePatentsOnline

Abstract

In some embodiments, a method receives a first image and a second image for a comparison of film grain. The first image and the second image are converted from a spatial domain to a frequency domain to generate a first frequency domain representation for the first image and a second frequency domain representation of the second image. The method compares a first distribution of frequency components from the first frequency domain representation to a second distribution of frequency components from the second frequency domain representation. A score for an assessment of differences of the film grain in the first image and the second image is generated based on the comparing.

Background

BACKGROUND

Film grain may be one of the distinguishing characteristics of videos that are produced, such as in videos captured by traditional film cameras (e.g., shows or movies produced by the movie industry). Film grain may be a perceptually pleasing noise that could be illustrated with artistic intention. However, including film grain in videos that are streamed over a network to client devices may pose technical challenges, such as the bitrate required to encode videos that include film grain may be high. This results in a high bandwidth requirement that may not be compatible with streaming environments. To save bandwidth, film grain may be removed from the videos before streaming the videos to client devices. However, viewers may not be satisfied with the visual quality of the videos without the film grain included.

One technique may be to synthesize film grain at the client device to add the film grain back on top of decoded video frames, which mimics the film grain in the source video. This process may introduce film grain back into the video. However, the film grain synthesis may be a challenging task to recover an accurate replica of the original film grain in the source video. Further, the film grain synthesis may also add undesirable effects to the video frames, such as new visual artifacts.

Claims

1. A method comprising: receiving a first image and a second image for a comparison of film grain; converting the first image and the second image from a spatial domain to a frequency domain to generate a first frequency domain representation for the first image and a second frequency domain representation of the second image; comparing a first distribution of frequency components from the first frequency domain representation to a second distribution of frequency components from the second frequency domain representation; and generating a score for an assessment of differences of the film grain in the first image and the second image based on the comparing. || 17. A non-transitory computer-readable storage medium having stored thereon computer executable instructions, which when executed by a computing device, cause the computing device to be operable for: receiving a first image and a second image for a comparison of film grain; converting the first image and the second image from a spatial domain to a frequency domain to generate a first frequency domain representation for the first image and a second frequency domain representation of the second image; comparing a first distribution of frequency components from the first frequency domain representation to a second distribution of frequency components from the second frequency domain representation; and generating a score for an assessment of differences of the film grain in the first image and the second image based on the comparing. || 20. An apparatus comprising: one or more computer processors; and a computer-readable storage medium comprising instructions for controlling the one or more computer processors to be operable for: receiving a first image and a second image for a comparison of film grain; converting the first image and the second image from a spatial domain to a frequency domain to generate a first frequency domain representation for the first image and a second frequency domain representation of the second image; comparing a first distribution of frequency components from the first frequency domain representation to a second distribution of frequency components from the second frequency domain representation; and generating a score for an assessment of differences of the film grain in the first image and the second image based on the comparing.