- Number
- 10121284
- Published
- 2018-11-06
- Filed
- 2014-09-24
- Assignee
- Disney Enterprises, Inc.
- Inventors
- Thiel; Aaron; Gay; Michael; Bailey; Anthony
- CPC
- G06T19/006; H04N13/282; H04N13/156; G06T19/003
- Verdict
- Medium Hardware
- Source
- Google Patents · FreePatentsOnline
The keeper's note
Motion-control camera system for AR.
Abstract
There is provided a system and method for integrating a virtual rendering system and a motion control system to provide an augmented three-dimensional reality. There is provided a method for integrating a virtual rendering system and a motion control system for outputting a composite three-dimensional render to a three-dimensional display, the method comprising obtaining, from the motion control system, a robotic three-dimensional camera configuration of a robotic three-dimensional camera in a real environment, programming the virtual rendering system using the robotic three-dimensional camera configuration to correspondingly control a virtual three-dimensional camera in a virtual environment, obtaining a virtually rendered three-dimensional feed using the virtual three-dimensional camera, capturing a video capture three-dimensional feed using the robotic three-dimensional camera, rendering the composite three-dimensional render by processing the feeds, and outputting the composite three-dimensional render to the three-dimensional display.
Background
BACKGROUND OF THE INVENTION1. Field of the Invention(1) The present invention relates generally to digital video. More particularly, the present invention relates to digital video rendering.2. Background Art(2) Modern commodity PC hardware and videogame consoles are often equipped with sufficient processing capability to enable high-resolution real-time three-dimensional graphics rendering. Even portable devices such as mobile phones and handheld gaming systems are often equipped with sealed down real-time three-dimensional graphics support. Such low-cost commodity graphics processing hardware has enabled a wide variety of entertainment and productivity applications to support enhanced visual presentations for greater user engagement and enjoyment.(3) In particular, real-time three-dimensional graphics rendering has found itself as a highly supportive role in live broadcast programming, especially for providing analysis and commentary. While materials such as pre-rendered animations or real life reenactments have been used previously for analysis and commentary, the time and resources required to produce such materials precludes their use for live events. Thus, for coverage of live sports and other events, low cost commodity graphics hardware can be utilized to provide timely analysis using composite renderings with real-time generated three-dimensional graphics, allowing the use of alternative or substitute object rendering, strategy simulations, information boxes, alternati
Claims
1. A method for integrating a virtual rendering system and a motion control system to output a composite three-dimensional render to a three-dimensional display, the method comprising: obtaining, from the motion control system, a first three-dimensional camera configuration, wherein the first three-dimensional camera configuration includes camera position data, camera field of view orientation data, camera movement data and camera lens characteristics data; programming the virtual rendering system using the first three-dimensional camera configuration to correspondingly control a first virtual three-dimensional camera in a virtual environment, wherein the virtual environment includes virtual objects without corresponding real objects in a real environment; obtaining, from the virtual rendering system, a first virtually rendered three-dimensional feed of the virtual environment and the virtual objects using the first virtual three-dimensional camera; capturing, from a video capture system, a first video capture three-dimensional feed of the real environment using the first three-dimensional camera configuration; rendering the composite three-dimensional render by processing the first virtually rendered three-dimensional feed and the first video capture three-dimensional feed; and outputting the composite three-dimensional render to the three-dimensional display; wherein outputting the composite three-dimensional render includes simulating a virtual person in one or more scenarios in the real environment having real elements for strategy analysis, and providing a camera fly-by view for each of the one or more scenarios, wherein the virtual person corresponds to a real person in the real environment.
10. A rendering controller for outputting a composite three-dimensional render to a three-dimensional display, the rendering controller comprising: a processor configured to: obtain, from a motion control system, a first three-dimensional camera configuration, wherein the first three-dimensional camera configuration includes camera position data, camera field of view orientation data, camera movement data and camera lens characteristics data; program a virtual rendering system using the first three-dimensional camera configuration to correspondingly control a first virtual three-dimensional camera in a virtual environment, wherein the virtual environment includes virtual objects without corresponding real objects in a real environment; obtain, from the virtual rendering system, a first virtually rendered three-dimensional feed of the virtual environment and the virtual objects using the first virtual three-dimensional camera; capture, from a video capture system, a first video capture three-dimensional feed of the real environment using the first three-dimensional camera configuration; render the composite three-dimensional render by processing the first virtually rendered three-dimensional feed and the first video capture three-dimensional feed; and output the composite three-dimensional render to the three-dimensional display; wherein outputting the composite three-dimensional render includes simulating a virtual person in one or more scenarios in the real environment having real elements for strategy analysis, and providing a camera fly-by view for each of the one or more scenarios, wherein the virtual person corresponds to a real person in the real environment.