In some embodiments, a grain analysis system is configured for analyzing a first video frame and outputting respective first film grain information for film grain that is included in the first video frame or configured for analyzing a second video frame and outputting second film grain information. At least one of a grain removal system and a grain synthesis system is included. The grain removal system is configured for removing the film grain from the first video frame using the first film grain information to generate a third video frame corresponding to the first video frame with film grain removed. The grain analysis system is separate from the grain removal system. The grain synthesis system is configured for synthesizing film grain for the third video frame using the first film grain information or the second film grain information. The grain analysis system is separate from the grain synthesis system.
BACKGROUND
Film grain may be one of the distinguishing characteristics of videos that are produced, such as in videos captured by traditional film cameras (e.g., shows or movies produced by the movie industry). Film grain may be a perceptually pleasing noise that could be illustrated with artistic intention. In video production and video restoration pipelines, film grain may be managed in different use cases. For example, film grain may be removed, and/or synthesized. The removal and synthesis processes may use separate models. These models may be trained independently to perform their respective task. Operating the synthesis and removal of film grain independently may not optimally use resources in the video production and video restoration pipeline.
1. A system comprising: a grain analysis system configured for analyzing a first video frame and outputting respective first film grain information for film grain that is included in the first video frame or configured for analyzing a second video frame and outputting second film grain information; and at least one of: a grain removal system configured for removing the film grain from the first video frame using the first film grain information to generate a third video frame corresponding to the first video frame with film grain removed, wherein the grain analysis system is separate from the grain removal system; or a grain synthesis system configured for synthesizing film grain for the third video frame using the first film grain information or the second film grain information, wherein the grain analysis system is separate from the grain synthesis system. ||
19. A non-transitory computer-readable storage medium having stored thereon computer executable instructions, which when executed by a computing device, cause the computing device to be operable for: analyzing, by a grain analysis system, a first video frame and outputting respective first film grain information for film grain that is included in the first video frame or analyzing a second video frame and outputting second film grain information; and at least one of: removing, by a grain removal system, the film grain from the first video frame using the first film grain information to generate a third video frame corresponding to the first video frame with film grain removed, wherein the grain analysis system is separate from the grain removal system; or synthesizing, by a grain synthesis system, film grain for the third video frame using the first film grain information or the second film grain information, wherein the grain analysis system is separate from the grain synthesis system. ||
20. A method comprising: analyzing, by a grain analysis system, a first video frame and outputting respective first film grain information for film grain that is included in the first video frame or analyzing a second video frame and outputting second film grain information; and at least one of: removing, by a grain removal system, the film grain from the first video frame using the first film grain information to generate a third video frame corresponding to the first video frame with film grain removed, wherein the grain analysis system is separate from the grain removal system; or synthesizing, by a grain synthesis system, film grain for the third video frame using the first film grain information or the second film grain information, wherein the grain analysis system is separate from the grain synthesis system.