Artifact processing in video using texture information

Number: 12639942
Published: 2026-05-26
Filed: 2024-05-02
Assignee: Disney Enterprises, Inc.
Inventors: Huangfu; Xuchang, Xue; Yuanyi, Zhang; Wenhao, Zhang; Yang, Liu; Chen, Meng; Xuewei
CPC: G06T7/40; G06V10/993; G06T11/10; G06V10/22; G06V10/273; G06V10/28; G06V10/36; G06V10/54; G06V10/761; G06V10/764; G06T2207/10024; G06T2207/20084; G06T2207/30168
Verdict: Set aside dropped in weekly review
Source: Google Patents · FreePatentsOnline

The keeper's note

a method receives an image to analyze for artifacts.

Abstract

In some embodiments, a method receives an image to analyze for artifacts. Texture information that characterizes texture in the image is determined. The method merges the texture information with the image. The texture information is used to focus an analysis of artifacts in regions of the image. The method outputs a score based on the processing of the image that assesses the artifacts in the image.

Background

BACKGROUND (1) Artifacts in digital video may be distortions that appear in the video. Different types of artifacts may occur. For example, one artifact is banding, which may be where a continuous change of luminance and chrominance becomes a sudden drop in values creating visible bands that should not be present in the video. The banding artifact may occur when the available bit depth for presenting the luminance or chrominance information is limited. That is, having 8 bits to represent the luminance and chrominance information may result in more visible bands compared to having more bit depth, such as 10 or 12 bits, to represent the luminance and chrominance information. Other artifacts may also result in video for different reasons. (2) A video delivery system may want to mitigate the occurrence of the artifacts that may occur in a video. However, it may be challenging to identify and measure the artifacts, and then later mitigate the artifacts.

Claims

1. A method comprising: receiving an image to analyze for artifacts; determining texture information that characterizes texture in the image; merging the texture information with the image, wherein the texture information is used to focus an analysis of artifacts in regions of the image, wherein merging the texture information with the image comprises: segmenting the image into a plurality of regions based on object detection of objects in respective regions; determining a difference in a characteristic of pixels in respective regions in the plurality of regions; and using the difference of the characteristic in respective regions to classify respective regions with a classification in a plurality of classifications, wherein using the difference of the characteristic to classify respective regions comprises: determining a category for pixels in a region; counting a first number of pixels in a first classification and a second number of pixels in a second classification; and determining whether the region is associated with the first classification or the second classification based on the first number of pixels and the second number of pixels, wherein: the region is associated with the first classification when the first number of pixels is less than a first threshold and the second number of pixels is greater than a second threshold, and the first threshold is based on a number of pixels that are classified as artifact pixels and the second threshold is based on a number of pixels that are categorized as texture pixels; and outputting a score based on the processing of the image that assesses the artifacts in the image. || 14. A non-transitory computer-readable storage medium having stored thereon computer executable instructions, which when executed by a computing device, cause the computing device to be operable for: receiving an image to analyze for artifacts; determining texture information that characterizes texture in the image; merging the texture information with the image, wherein the texture information is used to focus an analysis of artifacts in regions of the image, wherein merging the texture information with the image comprises: segmenting the image into a plurality of regions based on object detection of objects in respective regions; determining a difference in a characteristic of pixels in respective regions in the plurality of regions; and using the difference of the characteristic in respective regions to classify respective regions with a classification in a plurality of classifications, wherein using the difference of the characteristic to classify respective regions comprises; determining a category for pixels in a region; counting a first number of pixels in a first classification and a second number of pixels in a second classification; and determining whether the region is associated with the first classification or the second classification based on the first number of pixels and the second number of pixels, wherein: the region is associated with the first classification when the first number of pixels is less than a first threshold and the second number of pixels is greater than a second threshold, and the first threshold is based on a number of pixels that are classified as artifact pixels and the second threshold is based on a number of pixels that are categorized as texture pixels; and outputting a score based on the processing of the image that assesses the artifacts in the image. || 17. An apparatus comprising: one or more computer processors; and a computer-readable storage medium comprising instructions for controlling the one or more computer processors to be operable for: receiving an image to analyze for artifacts; determining texture information that characterizes texture in the image; merging the texture information with the image, wherein the texture information is used to focus an analysis of artifacts in regions of the image, wherein merging the texture information with the image comprises: segmenting the image into a plurality of regions based on object detection of objects in respective regions; determining a difference in a characteristic of pixels in respective regions in the plurality of regions; and using the difference of the characteristic in respective regions to classify respective regions with a classification in a plurality of classifications, wherein using the difference of the characteristic to classify respective regions comprises: determining a category for pixels in a region; counting a first number of pixels in a first classification and a second number of pixels in a second classification; and determining whether the region is associated with the first classification or the second classification based on the first number of pixels and the second number of pixels, wherein: the region is associated with the first classification when the first number of pixels is less than a first threshold and the second number of pixels is greater than a second threshold, and the first threshold is based on a number of pixels that are classified as artifact pixels and the second threshold is based on a number of pixels that are categorized as texture pixels; and outputting a score based on the processing of the image that assesses the artifacts in the image.