Reconstructs 3D scenes from high-resolution, high-frame-rate video by determining camera pose and 3D feature point coordinates throughout the footage (PGPUB duplicate).
Scenes reconstruction may be performed using videos that capture the scenes at high resolution and frame rate. Scene reconstruction may be associated with determining camera orientation and/or location (“camera pose”) throughout the video, three-dimensionalcoordinates of feature points detected in frames of the video, and/or other information. Individual videos may have multiple frames. Feature points may be detected in, and trackedover, the frames. Estimations of camera pose may be made for individual subsets of frames. One or more estimations of camera pose may be determined as fixed estimations. The estimated camera poses for the frames included in the subsets of frames may be updated based onthe fixed estimations. Camera pose for frames not included in the subsets of frames may be determined to provide globally consistent camera poses and three-dimensional coordinatesfor feature points of the video.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 illustrates a system configured for facilitating three-dimensional reconstruction of scenes from videos, in accordance with one or more implementations.
FIG. 2 illustrates an exemplary implementation of a server employed in the system of FIG. 1.
FIG. 3 illustrates a graphical representation of a process of performing piecewise camera pose estimations over select subsets of frames of a given video, in accordance with one or more implementations.
FIG. 4 illustrates a method of facilitating three-dimensional reconstruction of scenes from videos, in accordance with one or more implementations.DETAILED DESCRIPTION
FIG. 1 illustrates a system 100 configured for facilitating three-dimensional reconstruction of scenes from videos, in accordance with one or more implementations. A video may comprise a recorded video, a live feed, and/or other audiovisual asset. A given video may have multiple frames, a sound track, and/or other components.
In some implementations, the system 100 may comprise a server 102, one or more computing platforms 122, and/or other components. The server 102 may include oneor more physical processors 104 configured by machine-readable instructions 106. Executing the machine-readable instructions 106 may cause the one or more physical processors 104 to facilitate three-dimensional reconstruction of scenes from videos. The machine-readableinstructions 106 may include one or more of a vi
1. A system configured to facilitate three-dimensional reconstruction of scenes depicted in videos, the system comprising: one or more physical processors configured by machine-readable instructions to: obtain a video having multiple frames, the video depicting a first scene captured from a first camera, the firstscene including feature points within individual frames of the video, the feature points being tracked over consecutive frames by correlating the feature points between the consecutive frames, a first frame of the video including a first set of feature points, the first set of feature points being tracked from the first frame to one or more other frames by correlating the first set of feature points within the first frame with the first set of feature points present within the one or more other frames; make estimations of orientationand/or location of the first camera in the first scene for individual frames within a first subset of frames of the video and a second subset of frames of the video, the second subset of frames comprising at least one frame not included in the first subset of frames, the estimations being based on the detected and tracked feature points of the first subset of frames and second subsets of frames, such that an estimation of a first orientation and/or location of the first camera is made for a second frame in the first subset of frames based on the detected and tracked feature points in the first subset of frames, and an estimation of a second orientation and/or location of the first camera is made for a third frame in the second subset of frames based on detected feature points in the second subset of frames; determine estimations of camera orientation and/or location which provide fixed estimations of orientation and/or location; and determine orientation and/or location of the first camera in the frames of the video based on the estimated first camera orientationand/or location, estimated second camera orientation and/or location, and the fixed estimations of orientation and/or location, the determined orientation and/or location of the first camera for the frames of the video facilitating three-dimensional reconstruction of the first scene of the video.
11. A method of facilitating three-dimensional reconstructionof scenes depicted in videos, the method being implemented in a computer system comprising one or more physical processors and storage media storing machine-readable instructions,the method comprising: obtaining a video having multiple frames, the video depicting a first scene captured from a first camera, the first scene including feature points within individual frames of the video, the feature points being tracked over consecutive frames by correlating the feature points between the consecutive frames, a first frame of the video including a first set of feature points, the first set of feature points being tracked from the first frame to one or more other frames by correlating the first set of feature points within the first frame with the first set of feature points present within the one or more other frames; making estimations of orientation and/or location of the first camera inthe first scene for individual frames within a first subset of frames of the video and a second subset of frames of the video, the second subset of frames comprising at least one frame not included in the first subset of frames, the estimations being based on the detected and tracked feature points of the first subset of frames and second subsets of frames,including making an estimation of a first orientation and/or location of the first camerafor a second frame in the first subset of frames based on the detected and tracked feature points in the first subset of frames, and making an estimation of a second orientation and/or location of the first camera for a third frame in the second subset of frames based on detected feature points in the second subset of frames; determining estimations of camera orientation/location which provide fixed estimations of orientation and/or location; and determining orientation and/or location of the first camera in the frames of the video based on the estimated first camera orientation and/or location, estimated second camera orientation and/or location, and the fixed estimations of orientation and/or location, the orientation and/or location of the first camera for the frames of the video facilitating three-dimensional reconstruction of the first scene of the video.