Outer Rim Archives
Archives · 2017 · 20170091558

Application (pre-grant publication)

SYSTEMS AND METHODS FOR AUTOMATIC KEY FRAME EXTRACTION AND STORYBOARD INTERFACE GENERATION FOR VIDEO

Number
20170091558
Published
2017-03-30
Filed
2016-12-12
Assignee
DISNEY ENTERPRISES, INC./ETH Zürich
Inventors
Smolic; Aljoscha et al.
CPC
G06V20/48; G06F3/04842
Verdict
Low Notable software
Source
Google Patents · FreePatentsOnline

The keeper's note

Further continuation filing of #119/#120 (key-frame extraction/storyboard generation).

Abstract

A storyboard interface displaying key frames of a video may be presented to auser. Individual key frames may represent individual shots of the video. Shots may be grouped based on similarity. Key frames may be displayed in a chronological order of the corresponding shots. Key frames of grouped shots may be spatially correlated within the storyboard interface. For example, shots of a common group may be spatially correlated so that they may be easily discernable as a group even though the shots may not be temporally consecutive and/or or even temporally close to each other in the timeframe of the video itself.

Background

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a system configured for automatic key frame extraction and storyboard interface generation for video, in accordance with one or more implementations.

FIG. 2 illustrates an implementation of a server employed in the system of FIG. 1.

FIG. 3 illustrates a detection of text and/or face features displayed in an individual frame of a video, in accordance with one or more implementations.

FIG. 4 illustrates an exemplary storyboard interface corresponding to a video, in accordance with one or more implementations.

FIG. 5 illustrates a method of automatic key frame extraction and storyboard interface generation for video, in accordance with one or more implementations.DETAILED DESCRIPTION

FIG. 1 illustrates a system 100configured for automatic key frame extraction and storyboard interface generation for videos, in accordance with one or more implementations. A video may comprise a series of still images that may be presented in rapid succession to cause an appearance of movement of object, actors, and/or other elements portrayed in the images. A given image may correspondto a given frame of the video. A video may have multiple frames that individually correspond to an image, a sound track, and/or other components. A video may be a recorded video, a live video feed, and/or other audiovisual asset.

In some implementations, the system 100 may comprise a server 102, one or more computing plat

Claims

1. A system configured for automatic key frame extraction and storyboard interface generation for videos, the system comprising: one or more physical processors configured by machine-readable instructions to: obtain one or more videos having multiple frames,individual ones of the obtained one or more videos including a first video having a firstset of frames; identify discrete shots in the individual videos, a given shot in a given video including consecutive frames of the given video, the identified discrete shots in the first video including a first shot and a second shot; determine features of individual frames; determine two or more groups of shots for individual videos based on the determinedfeatures, a given group including one or more shots of a given video sharing similar features, such that responsive to a determination of a first frame of the first shot includinga first feature and a second frame of the second shot including a second feature, the first shot is assigned to a first group based on the first feature being similar to other features of other shots assigned to the first group, and the second shot is assigned to a second group based on the second feature being different from the first feature; select individual key frames representative of the individual shots, the first frame being selected asa first key frame of the first shot, and the second frame being selected as a second key frame of the second shot; effectuate presentation of the key frames in storyboard interfaces, a given storyboard interface of given video displaying corresponding key frames in a chronological order of the corresponding shots of the given video, wherein key frames of grouped shots of the given video are spatially correlated within the given storyboard interface, including effectuating presentation of the first key frame and the second key frame in a first storyboard interface, wherein the first key frame and other key frames of other shots assigned to the first group are spatially correlated in the first storyboard interface. 11. A method of automatic key frame extraction and storyboard interface generation forvideos, the method being implemented in a computer system including one or more physical processors and storage media storing machine-readable instructions, the method comprising:obtaining one or more videos having multiple frames, individual ones of the obtained one or more videos including a first video having a first set of frames; identifying discrete shots in the individual videos, a given shot in a given video including consecutive framesof the given video, including identifying a first shot and a second shot of the first video; determining features of individual frames; determining two or more groups of shots forindividual videos based on the determined features, a given group including one or more shots of a given video sharing similar features, such that responsive to a determination that a first frame of the first shot includes a first feature and a second frame of the second shot includes a second feature, determining that the first shot is assigned to a first group based on the first feature being similar to other features of other shots assigned to the first group, and determining that the second shot is assigned to a second group based on the second feature being different from the first feature; selecting individual key frames representative of the individual shots, including selecting the first frame as a first key frame of the first shot, and the second frame as a second key frame of the second shot; effectuating presentation of the key frames in storyboard interfaces, a given storyboard interface of given video displaying corresponding key frames in a chronological order of the corresponding shots of the given video, wherein key frames of grouped shots of the given video are spatially correlated within the given storyboard interface, including effectuating presentation of the first key frame and the second key frame in a first storyboard interface, wherein the first key frame and other key frames of other shots assigned to the first group are spatially correlated in the first storyboard interface.