Inserts 2D/3D graphics into stereoscopic live-action video using positional data from the stereoscopic camera rig.
Systems and methods for the insertion of graphics into stereoscopic live action 3D video using image models taking into account positional data from the stereoscopic camera rig.
BRIEF DESCRIPTIONS OF DRAWINGS(1) Embodiments of the invention are illustrated in the accompanying drawings in which:(2) FIG. 1 is an exemplary block diagram illustrating a multi-camera real-time three-dimensional video production system;(3) FIG. 2a is an exemplary block diagram of one channel of a multi-channel real-time three-dimensional video production system showing further detail.(4) FIG. 2b is an exemplary flowchart diagram of one channel of a multi-channel real-time three dimensional video production system.(5) FIG. 3 is an exemplary diagram of a visual perspective relative to an image plane.DETAILED DESCRIPTION OF THE INVENTION(6) Disclosed in embodiments herein is a method and system for a insertion of computer graphic objects into stereoscopic content for use in live 3D video streaming production and broadcast.(7) Graphic elements are added to video image streams to enhance a video production and add to the overall viewing experience of a viewer. Graphics can include, among others, first down line markers, object trackers, dynamic marking tools and telemetry interfaces. Object trackers, shown as icons on the screen, can include parameterized models that viewers see tracking players, race cars, footballs, hockey pucks, golf balls and the like. The tracker icon may be modeled so as to remain keyed in one place on the screen or alternatively to move with the object being tracked or move so as to avoid covering predetermined objects, such as a player's body or particul
1. A method of inserting a 3D graphic element into a 3D stereoscopic image generated from two cameras disposed on a camera rig, and compensating for optical effects of the camera rig, comprising: acquiring a first 2D video image frame captured by a first camera, the first camera being one of the cameras on the camera rig; acquiring first camera instrumentation data associated with the capture of the first 2D video image frame by the first camera; acquiring camera rig information associated with the camera rig; calculating one or more “unnatural disparities” associated with at least one of the first camera and the camera rig, based on the camera rig information including camera toe-in angle and camera separation, and at least one of the first camera instrumentation data and thefirst 2D video image frame, the “unnatural disparities” comprising at least a keystoning effect; adjusting the first 2D image frame based on the “unnatural disparities,” and providing a first adjusted 2D image; converting the 3D graphic element to a first adjusted 2D graphic element using a first virtual camera graphic synthesizer that models imaging of thefirst camera using a first image formation model, the first image formation model using first camera parameter values derived from at least one of the first camera instrumentationdata and the first 2D video image frame; and incorporating the first adjusted 2D graphic element into the first adjusted 2D image frame to generate a first combined video image frame.
12. A system for inserting a 3D graphic element into a 3D stereoscopic image generated from two cameras disposed on a camera rig, the camera rig having camera rig information associated with the camera rig, and compensating for optical effects of the camera rig, comprising: a first camera, configured to capture a first 2D video image frame, the first camera being one of the cameras on the camera rig, the first camera providing first camera instrumentation data associated with the capture of the first 2D video image frame by the first camera; a first 2D remapper configured to calculate one or more “unnatural disparities” associated with at least one of the first camera and the camera rig, based on the camera rig information including camera toe-in angle and camera separation, and at least one ofthe first camera instrumentation data and the first 2D video image frame, the “unnatural disparities” comprising at least a keystoning effect, and configured to adjust the first 2D image frame based on the “unnatural disparities,” the remapper providing a first adjusted 2D image; a first virtual camera graphic synthesizer configured to convert the 3D graphic element to a first adjusted 2D graphic element, the synthesizer arranged to model imaging of the first camera using a first image formation model, the first image formation modelusing first camera parameter values derived from at least one of the first camera instrumentation data and the first 2D video image frame; and a first keyer configured to incorporate the first adjusted 2D graphic element into the first adjusted 2D image frame to generate a first combined video image frame.