- Number
- 9571786
- Published
- 2017-02-14
- Filed
- 2015-10-15
- Assignee
- ETH ZURICH/DISNEY ENTERPRISES, INC.
- Inventors
- Zimmer; Henning et al.
- CPC
- G06T3/4084; H04N5/783
- Verdict
- Low Notable software
- Source
- Google Patents · FreePatentsOnline
The keeper's note
Frame-interpolation technique for video — novel rendering/video method.
Abstract
Interpolating frames of a video may provide a technique for one or more of frame rate conversion, temporal upsampling for generating slow motion video, image morphing, virtual view synthesis, and/or other video applications. A system may be configured to interpolated frames of a video by leveraging frequency domain representations of individualframes. The frequency domain representations may be decomposed into set of discrete functions that make up the frequency domain representations. Corresponding functions from sets of functions associated with frames with which an interpolated frame is to be determined may be identified. Phase differences between corresponding functions may be determined. Interpolated functions between the corresponding functions may be determined based on the determined phased differences. Information describing spatial domain representations of interpolated frames may be determined based on the interpolated functions.
Background
BRIEF DESCRIPTION OF THE DRAWINGS(1) FIG. 1 illustrates a system configured for interpolating frames of a video, in accordance with one or more implementations.(2)FIG. 2 illustrates an implementation of a server employed in the system of FIG. 1.(3) FIG. 3 illustrates a phase difference between corresponding simple sinusoidal functions, in accordance with one or more implementations.(4) FIG. 4 illustrates interpolating a sinusoidal function between corresponding simple sinusoidal functions based on a determined phase difference, in accordance with one or more implementations.(5) FIG. 5 illustrates a phase difference between simple sinusoidal functions, in accordance with one or more implementations.(6) FIG. 6 illustrates a depiction of multiple sinusoidal functions that are interpolated for corresponding sinusoidal functions based on a determined phase difference, in accordance with one or more implementations.(7) FIG. 7 illustrates a method of interpolating frames of a video, in accordance with one or more implementations.DETAILED DESCRIPTION(8) FIG. 1 illustrates a system 100 configured for interpolating frames of a video, in accordance with one or more implementations. A video may comprise a series of still images that may be presented in rapid succession to cause an appearance of movement of object, actors, and/or other elements portrayed in the images. A given image may correspond to a given frame of the video. A video may have multiple frames, a sound track, and/or othe
Claims
1. A system configured for interpolating frames of a video, the system comprising: one or more physical processors configured by machine-readable instructions to: obtain decompositions of afirst frequency domain representation of a first frame of a video and a second frequency domain representation of a second frame of the video, the decomposition of the first frequency domain representation comprising a first set of sinusoidal functions, the decomposition of the second frequency domain representation comprising a second set of sinusoidal functions, the first set including a first sinusoidal function, and the second set including a second sinusoidal function; determine phase differences between corresponding sinusoidalfunctions of the first set of sinusoidal functions and second set of sinusoidal functions, such that based on the first sinusoidal function corresponding to the second sinusoidal function, a first phase difference is determined between the first sinusoidal function andthe second sinusoidal function; interpolate sinusoidal functions for the corresponding sinusoidal functions based on the determined phase differences, the interpolation of sinusoidal functions comprising determining phases for individual interpolated sinusoidal functions, such that a third sinusoidal function is interpolated based on the first phase difference, the interpolation of the third sinusoidal function comprising determining a first phase of the third sinusoidal function by: adjusting the first phase difference based on one or more of a 2π ambiguity, a confidence factor, or a limiting threshold; and determining the first phase based on the adjusted first phase difference and one or both of a second phase of the first sinusoidal function or a third phase of the second sinusoidal function; and determine information describing spatial domain representations of interpolated frames based on the interpolated sinusoidal functions, such that information describing a spatialdomain representation of a third frame is determined based on the third sinusoidal function, the third frame corresponding to an interpolated frame between the first frame and second frame.
11. A method of interpolating frames of a video, the method being implemented in a computer system including one or more physical processors and storage media storing machine-readable instructions, the method comprising: obtaining decompositions of a first frequency domain representation of a first frame of a video and a second frequency domain representation of a second frame of the video, the decomposition of the first frequency domain representation comprising a first set of sinusoidal functions, the decomposition of thesecond frequency domain representation comprising a second set of sinusoidal functions, the first set including a first sinusoidal function, and the second set including a second sinusoidal function; determining phase differences between corresponding sinusoidal functions of the first set of sinusoidal functions and second set of sinusoidal functions, including based on the first sinusoidal function corresponding to the second sinusoidal function, determining a first phase difference between the first sinusoidal function and the second sinusoidal function; interpolating sinusoidal functions for the corresponding sinusoidal functions based on the determined phase differences, the interpolation of sinusoidal functions comprising determining phases for individual interpolated sinusoidal functions, including interpolating a third sinusoidal function based on the first phase difference, the interpolation of the third sinusoidal function comprising determining a first phase of thethird sinusoidal function by: adjusting the first phase difference based on one or more of a 2π ambiguity, a confidence factor, or a limiting threshold; and determining the first phase based on the adjusted first phase difference and one or both of a second phase of the first sinusoidal function or a third phase of the second sinusoidal function; and determining information describing spatial domain representations of interpolated frames based on the interpolated sinusoidal functions, including determining information describing a spatial domain representation of a third frame based on the third sinusoidal function, the third frame corresponding to an interpolated frame between the first frame and second frame.