Multi-virtual-camera capture/rendering control system.
There is provided a system and method for integrating a virtual rendering system and a video capture system using flexible camera control to provide an augmented reality. There is provided a method for integrating a virtual rendering system and a video capture system for outputting a composite render to a display, the method comprising obtaining, from the virtual rendering system, a virtual camera configuration of a virtual camera in a virtual environment, programming the video capture system using the virtual camera configuration to correspondingly control a robotic camera in a real environment, capturing a video capture feed using the robotic camera, obtaining a virtually rendered feed using the virtual camera, rendering the composite render by processing the feeds, and outputting the composite render to the display.
BACKGROUND OF THE INVENTION1. Field of the Invention(1) The present invention relates generally to digital video. More particularly, the present invention relates to digital video rendering.2. Background Art(2) Modern commodity PC hardware and videogame consoles are often equipped with sufficient processing capability to enable high-resolution real-time three-dimensional graphics rendering. Even portable devices such as mobile phones and handheld gaming systems are often equipped with scaled down real-time three-dimensional graphics support. Such low-cost commodity graphics processing hardware has enabled a wide variety of entertainment and productivity applications to support enhanced visual presentations for greater user engagement and enjoyment.(3) In particular, real-time three-dimensional graphics rendering has found itself as a highly supportive role in live broadcast programming. For example, coverage of sports and other live events can be readily enhanced with composite renderings using three-dimensional graphics for alternative or substitute object rendering, strategy simulations, information boxes, alternative viewpoints, and other effects. Although three-dimensional analysis tools that allow for real-time modification of live footage exist, they are limited to modifying existing video camera footage using prior camera paths and viewpoints. As a result, viewer engagement is low since the scope of analysis is so limited.(4) Accordingly, there is a need to overcome th
1. A method comprising: tracking a moving virtual object in a virtual environment by a first virtual camera traveling on a first virtual camera path; tracking the moving virtual object in the virtual environment by a second virtual camera traveling on a second virtual camera path; obtaining from the first virtual camera a first virtually rendered feed of the virtual environment while tracking the moving virtual object by the first virtual camera; obtaining from the second virtual camera a second virtually rendered feed of the virtual environment while tracking the moving virtual object by the second virtual camera; obtaining from a virtual rendering system a first virtual camera position data and a first virtual camera movement data of the first virtual camera while the first virtual camera is travelling on the virtual camera path and tracking the moving virtual object in the virtual environment; obtaining from the virtual rendering system a second virtual camera position data and a second virtual camera movement data of the second virtual camera while the second virtual camera is travelling on the second virtual camera path and tracking the moving virtual object in the virtual environment; providing a composite render by processing the first virtually rendered feed, the second virtually rendered feed, the first virtual camera position data, the second virtual camera position data, the first virtual camera movement data and the second virtual camera movement data, wherein the composite render combines the first virtually rendered feed and the second virtually rendered feed such that a juxtaposition of a first virtual element of the virtual environment and a second virtual element of the virtual environment is visually unobtrusive; outputting the composite render that combines the first virtually rendered feed and the second virtually rendered feed to the display.
11. A rendering controller comprising: one or more subsystems to: track a moving virtual object in a virtual environment by a first virtual camera traveling on a first virtual camera path; track the moving virtual object in the virtual environment by a second virtual camera traveling on a second virtual camera path; obtain from the first virtual camera a first virtually rendered feed of the virtual environment while tracking the moving virtual object by the first virtual camera; obtain from the second virtual camera a second virtually rendered feed of the virtual environment while tracking the moving virtual object by the second virtual camera; obtain from a virtual rendering system a first virtual camera position data and a first virtual camera movement data of the first virtual camera while the first virtual camera is travelling on the virtual camera path and tracking the moving virtual object in the virtual environment; obtain from the virtual rendering system a second virtual camera position data and a second virtual camera movement data of the second virtual camera while the second virtual camera is travelling on the second virtual camera path and tracking the moving virtual object in the virtual environment; provide a composite render by processing the first virtually rendered feed, the second virtually rendered feed, the first virtual camera position data, the second virtual camera position data, the first virtual camera movement data and the second virtual camera movement data, wherein the composite render combines the first virtually rendered feed and the second virtually rendered feed such that a juxtaposition of a first virtual element of the virtual environment and a second virtual element of the virtual environment is visually unobtrusive; and output the composite render that combines the first virtually rendered feed and the second virtually rendered feed to the display.