SALIENCY-WEIGHTED VIDEO QUALITY ASSESSMENT

Number: 20170154415
Published: 2017-06-01
Filed: 2015-11-30
Assignee: Disney Enterprises, Inc.
Inventors: AYDIN; TUNC OZAN et al.
CPC: H04N17/004; H04N19/85; H04N19/00; G06T7/0002
Verdict: Set aside saliency-weighted video quality assessment - generic video quality/compression
Source: Google Patents · FreePatentsOnline

Abstract

Systems and methods are disclosed for weighting the image quality prediction of any visual-attention-agnostic quality metric with a saliency map. By accounting for the salient regions of an image or video frame, the disclosed systems and methods may dramatically improve the precision of the visual-attention-agnostic quality metric during image or video quality assessment. In one implementation, a method of saliency-weighted video quality assessment includes: determining a per-pixel image quality vector of an encoded video frame; determining per-pixel saliency values of the encoded video frame or a reference video frame corresponding to the encoded video frame; and computing a saliency-weighted image quality metric of the encoded video frame by weighting the per-pixel image quality vector using the per-pixel saliency values.

Background

BRIEF DESCRIPTION OF THE DRAWINGS

The patent or application file contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawing(s) will be provided by theOffice upon request and payment of the necessary fee.

The present disclosure, in accordance with one or more various embodiments, is described in detail with reference to the following figures. The figures are provided for purposes of illustration only and merelydepict typical or example embodiments of the disclosure.

FIG. 1 illustrates an example environment in which saliency-weighted video quality assessment may take place in accordance with the present disclosure.

FIG. 2 is an operational flow diagram illustrating a method of saliency-weighted image quality assessment in accordance with the present disclosure.

FIG. 3 is an operational flow diagram illustrating an example method of computing a saliency map for an image in accordance with the present disclosure.

FIG.4A illustrates an example saliency-weighted video quality assessment graphical user interface that may be used in accordance with the present disclosure.

FIG. 4B illustratesan encoded video frame, a corresponding saliency map, and visual differences between the encoded and unencoded video frame that may be displayed by the GUI of FIG. 4A.

FIG. 5 is an operational flow diagram illustrating an example method of using the saliency-weighted image quality

Claims

1. A method, comprising: receiving an assessed image at a non-transitory computer readable medium; and one or more processors: determining aper-pixel image quality vector of the assessed image; determining per-pixel saliency values of the assessed image or a reference image corresponding to the assessed image; and computing a saliency-weighted image quality metric of the assessed image by weighting the per-pixel image quality vector using the per-pixel saliency values. 9. A system, comprising: one or more processors; and one or more non-transitory computer-readable mediums operatively coupled to at least one of the one or more processors and having instructions stored thereon that, when executed by at least one of the one or more processors, cause the system to: receive an assessed image; determine a per-pixel image quality vector of the assessed image; determine per-pixel saliency values of the assessed image or a reference image; andcompute a saliency-weighted image quality metric of the assessed image by weighting the per-pixel image quality vector using the per-pixel saliency values. 17. A method comprising: receiving an encoded video; determining a saliency-weighted image quality metric for each video frame of the encoded video; determining video frames of the encoded video with a saliency-weighted image quality metric that is below a threshold; and assembling a playlistincluding the video frames of the encoded video with a saliency-weighted image quality metric that is below the threshold.