Video Capture System Control Using Virtual Cameras for Augmented Reality

Number: 20180048876
Published: 2018-02-15
Filed: 2017-10-02
Assignee: DISNEY ENTERPRISES INC.
Inventors: Gay; Michael; Thiel; Aaron
CPC: H04N13/239; H04N13/156; G06T19/006
Verdict: Medium Hardware
Source: Google Patents · FreePatentsOnline

The keeper's note

Virtual-camera control for AR video capture.

Abstract

There is provided a system and method for integrating a virtual rendering system and a video capture system using flexible camera control to provide an augmented reality. There is provided a method for integrating a virtual rendering system and a video capture system for outputting a composite render to a display, the method comprising obtaining, from the virtual rendering system, a virtual camera configuration of a virtual camera in a virtual environment, programming the video capture system using the virtual camera configuration to correspondingly control a robotic camera in a real environment, capturing a video capture feed using the robotic camera, obtaining a virtually rendered feed using the virtual camera, rendering the composite render by processing the feeds, and outputting the composite render to the display.

Background

BACKGROUND OF THE INVENTION1. Field of the Invention

The present invention relates generally to digital video. More particularly, the present invention relates to digital video rendering.2. Background Art

Modern commodity PC hardware and videogame consoles are often equipped with sufficient processing capability to enable high-resolution real-time three-dimensional graphics rendering. Even portable devices such as mobile phones and handheld gaming systems are often equipped with scaled down real-time three-dimensional graphics support. Such low-cost commodity graphics processing hardware has enabled a wide variety of entertainment and productivity applications to support enhanced visual presentations for greater user engagement and enjoyment.

In particular, real-time three-dimensional graphics rendering has found itself as a highly supportive role in live broadcast programming. For example, coverage of sports and other live events can be readily enhanced with composite renderings using three-dimensional graphics for alternative or substitute object rendering, strategy simulations, information boxes, alternative viewpoints, and other effects. Although three-dimensional analysis tools that allow for real-time modification of live footage exist, they are limited to modifying existing video camera footage using prior camera paths and viewpoints. As a result, viewer engagement is low since the scope of analysis is so limited.

Accordingly, there is a need to

Claims

1. A method for integrating a virtual rendering system and a video capture system for outputting a composite render to a display, the method comprising: obtaining, from the virtual rendering system, a first virtual camera configuration of a first virtual camera in a virtual environment; programming the video capture system using the first virtual camera configuration to correspondingly control a first robotic camera in a real environment; capturing, from the video capture system, a first video capture feed of the real environment using the first robotic camera; obtaining, from the virtual rendering system, a first virtually rendered feed of the virtual environment using the first virtual camera; rendering the composite render by processing the first video capture feed and the first virtually rendered feed; and outputting the composite render to the display. 11. A rendering controller for outputting a composite render to a display, the rendering device comprising: a processor configured to: obtain, from a virtual rendering system, a virtual camera configuration of a first virtual camera in a virtual environment; program a video capture system using the virtual camera configuration to correspondingly control a first robotic camera in a real environment; capture, from the video capture system, a first video capture feed of the real environment using the first robotic camera; obtain, from the virtual rendering system, a first virtually rendered feed of the virtual environment using the first virtual camera; render the composite render by processing the first video capture feed and the first virtually rendered feed; and output the composite render to the display.