Embodiments relate to insertions in 3D video. Virtual camera models enable insertions to be reconciled relative to left and right channels of the 3D video to maximize 3D accuracy and realism of the insertions. Cameras are formed as composites, and can be derived from other models. The camera models can be based on a visual analysis of the 3D video, and can be based on 3D camera data including toe-in and ocular spacing. The camera data may be derived from information collected using instrumentation connect to a 3D camera system, derived based on visual analysis of the 3D video, or derived using a combination of information collected using instrumentation and visual analysis of 3D video. Insertions can be made on-site or at a remote site, and camera data can be embedded in the 3D video and/or separately transmitted to a remote site. Insertions can be adjusted in 3D space based on a type of insertion, the 3D video scene composition, and/or user feedback, including interactive adjustment of 3D insertions and adjustments in view of user sensitivity to eye strain.
BACKGROUND(1) Field of Invention(2) Embodiments relate to virtual insertions into 3D video.(3) Background Art(4) Methods for streaming video content to viewers may utilize stereoscopy to project program content into a 3D field. 3D capable systems may transmit separate channels for left and right eye images, providing parallax views of scenes. Although methods to add virtual insertions into conventional 2D video are known, such known 2D methods may not be adequate to provide optimum viewing experiences for viewers of 3D video. Accordingly, there is a need for providing realistic-looking virtual insertions in 3D video that appear to viewers as though the insertions were part of the original production.
1. A method comprising: determining a first camera data parameter of a first camera model associated with a first channel of a 3D video, wherein the first camera model describes the field of view of the first channel; determining a second camera data parameter of a second camera model associated with a second channel of the 3D video, wherein the second camera model describes the field of view of the second channel, wherein determining the first camera data parameter and second camera data parameter is based on a search analysis of at least the first channel, wherein the search analysis is based on voxels corresponding to at least the first channel and, wherein the search analysis is constrained within a region of at least the first channel that is less than the field of view of at least the first channel and the region is based on a relationship between the first channel and the second channel of 3D video; generating a composite camera model by reconciling the first camera data parameter of the first camera model and the second camera data parameter of the second camera model; and inserting an enhancement into the 3D video based on the composite camera model.
21. A system comprising: a first search module for determining a first camera model associated with a first channel of a 3D video, wherein the first camera model describes the field of view of the first channel; a second search module for determining a second camera model associated with a second channel of the 3D video, wherein the second camera model describes the field of view of the second channel, wherein determining the first camera model and the second camera model is based on a search analysis of at least the first channel, wherein the search analysis is based on voxels corresponding to at least the first channel and, wherein the search analysis is constrained within a region of at least the first channel that is less than the field of view of at least the first channel and the region is based on a relationship between the first channel and the second channel of 3D video; a controller module for generating a composite camera model by reconciling the first camera model and the second camera model, and a mixer module for inserting an enhancement into the 3D video based on the composite camera model.
22. A method comprising: receiving a first camera data parameter associated with at least one of a first camera model and a second camera model, wherein the first camera model is associated with a first channel of a 3D video and describes the field of view of the first channel and wherein the second camera model is associated with a second channel of the 3D video and describes the field of view of the second channel; receiving a second camera data parameter associated with the at least one of the first camera model and the second camera model; wherein determining the first camera data parameter and the second camera data parameter is based on a search analysis of at least the first channel, wherein the search analysis is based on voxels corresponding to at least the first channel, and wherein the search analysis is constrained within a region of at least the first channel and the region is based on a relationship between the first channel and the second channel of 3D video; generating a composite camera model based on at least the first camera data parameter and the second camera data parameter, and inserting an enhancement into the 3D video based on the composite camera model, wherein the inserting is performed remotely from an on-site production pipe-line stage.