- Number
- 10157318
- Published
- 2018-12-18
- Filed
- 2016-12-12
- Assignee
- Disney Enterprises, Inc.; ETH Zurich
- Inventors
- Smolic; Aljoscha et al.
- CPC
- G11B27/22; G11B27/105; G06F3/04842; G06V20/40; G06V20/41; G06F18/23; G11B27/34; G06V20/46; G06V20/48; G11B27/28
- Verdict
- Set aside video editing tool/plumbing
- Source
- Google Patents · FreePatentsOnline
Abstract
A storyboard interface displaying key frames of a video may be presented to a user. Individual key frames may represent individual shots of the video. Shots may be grouped based on similarity. Key frames may be displayed in a chronological order of the corresponding shots. Key frames of grouped shots may be spatially correlated within the storyboard interface. For example, shots of a common group may be spatially correlated so that they may be easily discernable as a group even though the shots may not be temporally consecutive and/or or even temporally close to each other in the timeframe of the video itself.
Background
FIELD OF THE DISCLOSURE(1) This disclosure relates to automatic key frame extraction and storyboard interface generation for videos.BACKGROUND(2) The use of video in reaching audiences has widened significantly in recent years, presenting a plethora of new video content as well as numerous ways to consume it. Efficiency in handling and visualizing such large amounts of video is becoming a vital prerequisite in the media sector, which may call for operational improvements in the creative and distribution processes behind video type media.(3) Within a video, a shot may refer to a video sequence captured from a unique camera perspective without cuts and/or other cinematic transitions. Improvements in navigation through video and content highlighting, such as user-selection of key frames or thumbnails for a given shot, may directly influence the time spent in production and/or content management. The selection and presentation of key frames of a video and/or thumbnails of the key frames, and/or other techniques for intuitive visualization of a video, may help to shape the viewing experience and may offer viewers a faster access to their desired content. For example, key frames and/or thumbnails, may be visually presented to a user in an interface including a one-dimensional timeline, often referred to as a “storyboard.” Individual key frames and/or thumbnails may be positioned at locations on the timeline corresponding to their temporal order in the video. The users may be able t
Claims
1. A system configured for storyboard interface generation for videos, the system comprising: one or more physical processors configured by machine-readable instructions to: obtain a video having multiple frames, the multiple frames including a first frame and a second frame, individual frames of the video having individual features such that the first frame includes a first feature and the second frame includes a second feature, the video including discrete shots, individual shots of the video including consecutive frames of the video, individual shots being assigned to one or more groups, an individual group including one or more shots sharing similar features, the video further including one or more key frames, individual key frames being representative of the individual shots, such that the video includes a first shot including the first frame, a first key frame of the first shot, a second shot including the second frame, a second key frame of the second shot, a first group of shots including the first shot based on the first feature being similar to other features of other shots assigned to the first group, and a second group of shots including the second shot based on the second feature being different from the first feature; and effectuate presentation of the key frames in a first storyboard interface of the video, the first storyboard interface displaying corresponding key frames in a chronological order of the corresponding shots of the video, wherein key frames of grouped shots of the video are spatially correlated within the first storyboard interface, including effectuating presentation of the first key frame and the second key frame in the first storyboard interface, wherein the first key frame and other key frames of other shots assigned to the first group are spatially correlated in the first storyboard interface, the first storyboard interface including a two dimensional array, the array including a time-dependent dimension and a group-dependent dimension, wherein the chronological order of the shots of the video is represented by positions of the key frames with respect to the time-dependent dimension and the grouping of the shots is represented by positions of the key frames with respect to the group-dependent dimension.
10. A method of storyboard interface generation for videos, the method being implemented in a computer system including one or more physical processors and storage media storing machine-readable instructions, the method comprising: obtaining a video having multiple frames, the multiple frames including a first frame and a second frame, individual frames of the video having individual features such that the first frame includes a first feature and the second frame includes a second feature, the video including discrete shots, individual shots of the video including consecutive frames of the video, individual shots being assigned to one or more groups, an individual group including one or more shots sharing similar features, the video further including one or more key frames, individual key frames being representative of the individual shots, such that the video includes a first shot including the first frame, a first key frame of the first shot, a second shot including the second frame, a second key frame of the second shot, a first group of shots including the first shot based on the first feature being similar to other features of other shots assigned to the first group, and a second group of shots including the second shot based on the second feature being different from the first feature; and effectuating presentation of the key frames in a first storyboard interface of the video, the first storyboard interface displaying corresponding key frames in a chronological order of the corresponding shots of the video, wherein key frames of grouped shots of the video are spatially correlated within the first storyboard interface, including effectuating presentation of the first key frame and the second key frame in the first storyboard interface, wherein the first key frame and other key frames of other shots assigned to the first group are spatially correlated in the first storyboard interface, the first storyboard interface including a two dimensional array, the array including a time-dependent dimension and a group-dependent dimension, wherein the chronological order of the shots of a given video is represented by positions of the key frames with respect to the time-dependent dimension and the grouping of the shots is represented by positions of the key frames with respect to the group-dependent dimension.