- Number
- 11418840
- Published
- 2022-08-16
- Filed
- 2019-05-20
- Assignee
- Disney Enterprises, Inc.
- Inventors
- Varis Doggett; Erika Elizabeth, Wolak; Anna M. C., Sigal; Leonid
- CPC
- H04N21/23418; H04N7/0122; G11B27/28; H04N21/440272; G06T7/11; G11B27/031; H04N21/440281
- Verdict
- Set aside video QC/aspect-ratio detection, generic
- Source
- Google Patents · FreePatentsOnline
Abstract
Techniques are disclosed for recognizing aspect ratio errors in image frames of a video and reporting the same. An aspect ratio checker application receives a video that includes multiple image frames and identifies aspect ratio changes in those image frames using a first differential of a time series that includes determined positions of the top, bottom, left, and right of content regions within the image frames. In particular, the aspect ratio checker may identify aspect ratio changes based on non-zero points of the first differential, and the aspect ratio checker further determines aspect ratios of content regions within image frames corresponding to the non-zero points of the first differential. In addition, the aspect ratio checker may generate and display a report indicating the determined aspect ratios and image frame ranges associated with those aspect ratios.
Background
BACKGROUND Field of the Disclosure (1) Aspects presented in this disclosure generally relate to recognizing aspect ratio errors in image frames of a video. Description of the Related Art (2) The aspect ratio of an image is a proportional relationship between a width of the image and a height of the image. Various aspect ratios have been introduced for different exhibition and broadcast media, such as the standard 1.33:1 aspect ratio for television viewing and the 1:78:1 widescreen aspect ratio for viewing in cinemas. Black bars may be added to the image frames of a video, on the top and bottom and/or sides, in order to transfer the video from one aspect ratio to another while preserving the original aspect ratio. For example, letterboxing has been used to transfer widescreen aspect ratio videos to standard-width video formats by adding black bars to the top and bottom of the widescreen aspect ratio videos. (3) When black bars are added to the image frames of a video, aspect ratio errors may be introduced such that non-black regions of the image frames do not maintain a desired aspect ratio. For example, a row (or column) of pixels in an image frame may become part of the surrounding black bars instead of the desired image, or the non-black regions in the image frames of a video may suddenly switch from one aspect ratio to another. Manual identification of such aspect ratio errors is a time consuming process that can cause eye fatigue and attention strain, and humans can also
Claims
1. A computer-implemented method for recognizing aspect ratio errors in a video including a plurality of image frames, the computer-implemented method comprising: determining, for each image frame of the plurality of image frames, positions of a top and a bottom of a content region in the image frame by skipping completely black rows at a top and a bottom of the image frame until the top and the bottom, respectively, of the content region are reached, wherein all pixels in a completely black row have color values within a threshold from a color value for black; determining, for the image frame, positions of a left and a right of the content region in the image frame; generating at least one time series based, at least in part, on the determined positions; determining at least one first differential of the at least one time series; and determining that an aspect ratio error exists based on identifying non-zero points in the at least one first differential of the at least one time series, wherein the video is processed to remove the aspect ratio error. ||
9. A non-transitory computer-readable medium including instructions that, when executed by a processing unit, cause the processing unit to recognize aspect ratio errors in a video including a plurality of image frames, by performing operations comprising: determining, for each image frame of the plurality of image frames, positions of a top and a bottom of a content region in the image frame by skipping completely black rows at a top and a bottom of the image frame until the top and the bottom, respectively, of the content region are reached, wherein all pixels in a completely black row have color values within a threshold from a color value for black; determining, for each image frame of the plurality of image frames, positions of a left and a right of the content region in the image frame; generating at least one time series based, at least in part, on the determined positions; determining at least one first differential of the at least one time series; and determining that an aspect ratio error exists based on identifying non-zero points in the at least one first differential of the at least one time series, wherein the video is processed to remove the aspect ratio error. ||
17. A system for recognizing aspect ratio errors in a video including a plurality of image frames, the system comprising: a computer processor; and a memory containing a program that, when executed on the computer processor, performs operations comprising: determining, for each image frame of the plurality of image frames, positions of a top and a bottom of a content region in the image frame by skipping completely black rows at a top and a bottom of the image frame until the top and the bottom, respectively, of the content region are reached, wherein all pixels in a completely black row have color values within a threshold from a color value for black; determining, for each image frame of the plurality of image frames, positions of a left and a right of the content region in the image frame; generating at least one time series based, at least in part, on the determined positions; determining at least one first differential of the at least one time series; and determining that an aspect ratio error exists based on identifying non-zero points in the at least one first differential of the at least one time series, wherein the video is processed to remove the aspect ratio error.