Application (pre-grant publication)
Apparatus, Systems and Methods For Nonlinear Synchronization Of Action Videos
- Number
- 20180176423
- Published
- 2018-06-21
- Filed
- 2016-12-15
- Assignee
- Disney Enterprises, Inc.
- Inventors
- Bazin; Jean-Charles et al.
- CPC
- G06V20/48; G06V10/40; G06V10/62; G06T7/248; H04N5/04; G06T7/215
- Verdict
- Set aside action-video synchronization tool, editing plumbing
- Source
- Google Patents · FreePatentsOnline
Abstract
Described herein are apparatus, systems and methods for synchronizing a reference video with an input video. A method comprises extracting first motion data from the input video having a first set of frames, extracting second motion data from the reference video having a second set of frames, computing motion descriptors for each frame in the first set of frames and the second set of frames based on the first and second motion data, respectively, and non-linearly mapping the first set of frames to the second set of frames based on the motion descriptors, respectively.
Background
BACKGROUND
Video synchronization aims to temporarily align a set of input videos acquired by multiple cameras. Video synchronization may be a fundamental step for many applications in computer vision, such as three-dimensional (“3D”) reconstruction from multiple cameras, video morphing, facial performance manipulation, spatial compositing, motion analysis, etc. When several cameras are simultaneously used to acquire multiple viewpoint shots of a scene, then synchronization may be trivially achieved by using timecode information or camera triggers.
In the absence of timecode information and camera triggers, the videos may be synchronized using a recorded audio track, wherein the synchronization finds a fixed time offset between the cameras. Furthermore, videos may be synchronized through manual alignment, such as by finding video frame correspondence and manually computing the required time offset. However, these techniques require time-consuming manual effort for video alignment.
Existing video synchronization methods have significant limitations. For instance, existing techniques typically require simultaneously acquired viewpoint shots of a scene, videos that are acquired in the same location, a fixed temporal offset between the cameras, specific use cases (e.g., videos of faces), a similar appearance change, a combination thereof, etc.SUMMARY
Described herein are apparatus, systems and methods for nonlinear synchronization of action videos.
A