- Number
- 9552520
- Published
- 2017-01-24
- Filed
- 2015-07-07
- Assignee
- Disney Enterprises, Inc./ETH Zurich
- Inventors
- Smolic; Aljoscha et al.
- CPC
- G06V20/46; G11B27/22
- Verdict
- Low Notable software
- Source
- Google Patents · FreePatentsOnline
The keeper's note
Granted continuation of #119 (key-frame extraction/storyboard generation).
Abstract
A storyboard interface displaying key frames of a video may be presented to a user. Individual key frames may represent individual shots of the video. Shots may be grouped based onsimilarity. Key frames may be displayed in a chronological order of the corresponding shots. Key frames of grouped shots may be spatially correlated within the storyboard interface. For example, shots of a common group may be spatially correlated so that they may be easily discernable as a group even though the shots may not be temporally consecutive and/oror even temporally close to each other in the timeframe of the video itself.
Background
BRIEF DESCRIPTION OF THE DRAWINGS(1) FIG. 1illustrates a system configured for automatic key frame extraction and storyboard interface generation for video, in accordance with one or more implementations.(2) FIG. 2 illustrates an implementation of a server employed in the system of FIG. 1.(3) FIG. 3 illustratesa detection of text and/or face features displayed in an individual frame of a video, in accordance with one or more implementations.(4) FIG. 4 illustrates an exemplary storyboardinterface corresponding to a video, in accordance with one or more implementations.(5) FIG. 5 illustrates a method of automatic key frame extraction and storyboard interface generation for video, in accordance with one or more implementations.DETAILED DESCRIPTION(6) FIG. 1 illustrates a system 100 configured for automatic key frame extraction and storyboardinterface generation for videos, in accordance with one or more implementations. A video may comprise a series of still images that may be presented in rapid succession to cause an appearance of movement of object, actors, and/or other elements portrayed in the images.A given image may correspond to a given frame of the video. A video may have multiple frames that individually correspond to an image, a sound track, and/or other components. A video may be a recorded video, a live video feed, and/or other audiovisual asset.(7) In someimplementations, the system 100 may comprise a server 102, one or more computing platforms 122, and/or oth
Claims
1. A system configured for automatic key frame extraction and storyboard interface generation for videos, the system comprising: one or more physical processors configured by machine-readable instructions to: obtain one or more videos having multiple frames, individual ones of the obtained one or more videos including a first video having a first set of frames; identify discrete shots in the individual videos, a given shot in a given video including consecutive frames of the given video, the identified discrete shots in the first videoincluding a first shot and a second shot; determine features of individual frames; determine two or more groups of shots for individual videos based on the determined features, a given group including one or more shots of a given video sharing similar features, such that responsive to a determination of a first frame of the first shot including a first feature and a second frame of the second shot including a second feature, the first shot is assigned to a first group based on the first feature being similar to other features of other shots assigned to the first group, and the second shot is assigned to a second group based on the second feature being different from the first feature; select individual key frames representative of the individual shots, the first frame being selected as a first key frame of the first shot, and the second frame being selected as a second key frame of the second shot; effectuate presentation of the key frames in storyboard interfaces, a given storyboard interface of given video displaying corresponding key frames in a chronological order of the corresponding shots of the given video, wherein key frames of grouped shots of the given video are spatially correlated within the given storyboard interface, including effectuating presentation of the first key frame and the second key frame in a first storyboard interface, wherein the first key frame and other key frames of other shots assigned to the first group are spatially correlated in the first storyboard interface, such thatan individual storyboard interface includes a two dimensional array, the array including a time-dependent dimension and a group-dependent dimension, wherein the chronological order of the shots of a given video is represented by positions of the key frames with respectto the time-dependent dimension and the grouping of the shots is represented by positionsof the key frames with respect to the group-dependent dimension.
10. A method of automatic key frame extraction and storyboard interface generation for videos, the method being implemented in a computer system including one or more physical processors and storage mediastoring machine-readable instructions, the method comprising: obtaining one or more videos having multiple frames, individual ones of the obtained one or more videos including a first video having a first set of frames; identifying discrete shots in the individual videos, a given shot in a given video including consecutive frames of the given video, including identifying a first shot and a second shot of the first video; determining features of individual frames; determining two or more groups of shots for individual videos based on the determined features, a given group including one or more shots of a given video sharing similar features, such that responsive to a determination that a first frame of the first shot includes a first feature and a second frame of the second shot includes a second feature, determining that the first shot is assigned to a first group based on the first feature being similar to other features of other shots assigned to the first group, and determining that the second shot is assigned to a second group based on the second feature being different from the first feature; selecting individual key frames representative of the individual shots, including selecting the first frame as a first key frame of the first shot, and the second frame as a second key frame of the second shot; effectuating presentation of the key frames in storyboard interfaces, a given storyboard interface of given videodisplaying corresponding key frames in a chronological order of the corresponding shots of the given video, wherein key frames of grouped shots of the given video are spatially correlated within the given storyboard interface, including effectuating presentation of thefirst key frame and the second key frame in a first storyboard interface, wherein the first key frame and other key frames of other shots assigned to the first group are spatiallycorrelated in the first storyboard interface, such that an individual storyboard interface includes a two dimensional array, the array including a time-dependent dimension and a group-dependent dimension, wherein the chronological order of the shots of a given video isrepresented by positions of the key frames with respect to the time-dependent dimension and the grouping of the shots is represented by positions of the key frames with respect tothe group-dependent dimension.