ASPECT RATIO ERROR RECOGNITION

Number: 20200374585
Published: 2020-11-26
Filed: 2019-05-20
Assignee: Disney Enterprises, Inc.
Inventors: VARIS DOGGETT; Erika Elizabeth, WOLAK; Anna M.C., SIGAL; Leonid
CPC: G11B27/28; H04N21/440281; G11B27/031; H04N21/23418; G06T7/11; H04N21/440272; H04N7/0122
Verdict: Set aside aspect ratio QC tool, media production quality control
Source: Google Patents · FreePatentsOnline

Abstract

Techniques are disclosed for recognizing aspect ratio errors in image frames of a video and reporting the same. An aspect ratio checker application receives a video that includes multiple image frames and identifies aspect ratio changes in those image frames using a first differential of a time series that includes determined positions of the top, bottom, left, and right of content regions within the image frames. In particular, the aspect ratio checker may identify aspect ratio changes based on non-zero points of the first differential, and the aspect ratio checker further determines aspect ratios of content regions within image frames corresponding to the non-zero points of the first differential. In addition, the aspect ratio checker may generate and display a report indicating the determined aspect ratios and image frame ranges associated with those aspect ratios.

Background

BACKGROUNDField of the Disclosure

Aspects presented in this disclosure generally relate to recognizing aspect ratio errors in image frames of a video.Description of the Related Art

The aspect ratio of an image is a proportional relationship between a width of the image and a height of the image. Various aspect ratios have been introduced for different exhibition and broadcast media, such as the standard 1.33:1 aspect ratio for television viewing and the 1:78:1 widescreen aspect ratio for viewing in cinemas. Black bars may be added to the image frames of a video, on the top and bottom and/or sides, in order to transfer the video from one aspect ratio to another while preserving the original aspect ratio. For example, letterboxing has been used to transfer widescreen aspect ratio videos to standard-width video formats by adding black bars to the top and bottom of the widescreen aspect ratio videos.

When black bars are added to the image frames of a video, aspect ratio errors may be introduced such that non-black regions of the image frames do not maintain a desired aspect ratio. For example, a row (or column) of pixels in an image frame may become part of the surrounding black bars instead of the desired image, or the non-black regions in the image frames of a video may suddenly switch from one aspect ratio to another. Manual identification of such aspect ratio errors is a time consuming process that can cause eye fatigue and attention strain, and humans can a

Claims

1. A computer-implemented method for recognizing aspect ratio errors in a video including a plurality of image frames, the method comprising: determining, for each image frame of the plurality of image frames, positions of a top, bottom, left, and right of a content region in the image frame; generating at least one time series based, at least in part, on the determined positions; and determining aspect ratios of content regions in image frames corresponding to non-zero points in at least one first differential of the at least one time series. 10. A non-transitory computer-readable storage medium including instructions that, when executed by a processing unit, cause the processing unit to recognize aspect ratio errors in a video including a plurality of image frames, by performing operations comprising: determining, for each image frame of the plurality of image frames, positions of a top, bottom, left, and right of a content region in the image frame; generating at least one time series based, at least in part, on the determined positions; and determining aspect ratios of content regions in image frames corresponding to non-zero points in at least one first differential of the at least one time series. 19. A system, comprising: a computer processor; and a memory containing a program that, when executed on the computer processor, performs operations for recognizing aspect ratio errors in a video including a plurality of image frames, the operations comprising: determining, for each image frame of the plurality of image frames, positions of a top, bottom, left, and right of a content region in the image frame, generating at least one time series based, at least in part, on the determined positions, and determining aspect ratios of content regions in image frames corresponding to non-zero points in at least one first differential of the at least one time series.