- Number
- 9751015
- Published
- 2017-09-05
- Filed
- 2014-07-23
- Assignee
- Disney Enterprises, Inc.
- Inventors
- Gay; Michael, Thiel; Aaron
- CPC
- A63F13/213; H04N13/221; H04N13/282; G06T19/006; A63F13/655; A63F13/525; H04N13/239
- Verdict
- Medium Notable software
- Source
- Google Patents · FreePatentsOnline
The keeper's note
Integrates virtual rendering with video capture and multi-client input to broadcast an augmented reality videogame.
Abstract
There is provided a system and method for integrating a virtual rendering system and a video capture system using flexible camera control to provide an augmented reality. There is provided a method comprising receiving input data from a plurality of clients for modifying a virtual environment presented using the virtual rendering system, obtaining, from the virtual rendering system, a virtual camera configuration of a virtual camera in the virtual environment, programming the video capture system using the virtual camera configuration to correspondingly control a robotic camera in a real environment, capturing a video capture feed using therobotic camera, obtaining a virtually rendered feed using the virtual camera showing the modifying of the virtual environment, rendering the composite render by processing the feeds, and outputting the composite render to the display.
Background
BRIEF DESCRIPTION OF THE DRAWINGS(1) The features and advantages of the present invention will become more readily apparent to those ordinarily skilled in the art after reviewing the following detailed description and accompanying drawings, wherein:(2) FIG. 1 presents a system for integrating a virtual rendering system and a video capture system usingflexible camera control to provide an augmented reality for videogame broadcast programming, according to one embodiment of the present invention;(3) FIG. 2 presents a diagram of a robotic camera path configured to match a virtual camera path, according to one embodiment of the present invention;(4) FIG. 3 presents a diagram of a composite render being generated, according to one embodiment of the present invention; and(5) FIG. 4 shows a flowchart describing the steps, according to one embodiment of the present invention, by a virtual rendering system and a video capture system may be integrated for outputting a compositerender of an augmented reality for videogame broadcast programming to a display.DETAILED DESCRIPTION OF THE INVENTION(6) The present application is directed to a system and methodfor integrating a virtual rendering system and a video capture system using flexible camera control to provide an augmented reality for videogame broadcast programming. The following description contains specific information pertaining to the implementation of the present invention. One skilled in the art will recognize that the prese
Claims
1. A method for integrating a virtual rendering system and a video capture system for outputting a composite render to a display, the method comprising: receiving input data from a plurality of clients for modifying a virtual environment presented using the virtual rendering system; obtaining, from the virtual rendering system, a first virtual camera configuration of a first virtual camera in the virtual environment and a second virtual camera configuration of a secondvirtual camera in the virtual environment, wherein the first virtual camera configurationand the second virtual camera configuration include camera movement data including a first motion path of the first virtual camera in the virtual environment and a second motion path of the second virtual camera in the virtual environment, respectively, and wherein thefirst motion path tracks a path of a virtual object in motion relative to the first virtual camera and the second motion path tracks the path of the virtual object relative to thesecond virtual camera; programming the video capture system using the first virtual camera configuration to correspondingly control a first robotic camera in a real environment and using the second virtual camera configuration to correspondingly control a second robotic camera in the real environment; capturing, from the video capture system, a first video capture feed of the real environment using the first robotic camera and a second video capture feed of the real environment using the second robotic camera; obtaining, from the virtual rendering system, a first virtually rendered feed of the virtual environment using the first virtual camera and a second virtually rendered feed of the virtual environment using the second virtual camera, wherein the first virtually rendered feed and the second virtually rendered feed show the modifying of the virtual environment; rendering the composite render by processing the first video capture feed, the first virtually rendered feed, the second video capture feed and the second virtually rendered feed; and outputting the composite render to the display by simultaneously displaying the first virtually rendered feed and the second virtually rendered feed, wherein the first virtually rendered feed corresponds to a birdseye view of the virtual environment and the second virtually rendered feedcorresponds to a flyby view of the virtual environment.
9. A rendering controller for outputting a composite render to a display, the rendering controller comprising: a processor configured to: receive input data from a plurality of clients for modifying a virtual environment presented using a virtual rendering system; obtain, from the virtual rendering system, a first virtual camera configuration of a first virtual camera in the virtual environment and a second virtual camera configuration of a second virtual camera in the virtual environment, wherein the first virtual camera configuration and the second virtual camera configuration include camera movement data including a first motion path of the first virtual camera in the virtual environment and a second motion path of the second virtual camerain the virtual environment, respectively, and wherein the first motion path tracks a pathof a virtual object in motion relative to the first virtual camera and the second motion path tracks the path of the virtual object relative to the second virtual camera; program a video capture system using the virtual camera configuration to correspondingly control afirst robotic camera in a real environment and using the second virtual camera configuration to correspondingly control a second robotic camera in the real environment; capture, from the video capture system, a first video capture feed of the real environment using thefirst robotic camera and a second video capture feed of the real environment using the second robotic camera; obtain, from the virtual rendering system, a first virtually renderedfeed of the virtual environment using the first virtual camera and a second virtually rendered feed of the virtual environment using the second virtual camera, wherein the first virtually rendered feed and the second virtually rendered feed show the modifying of the virtual environment; render the composite render by processing the first video capture feed,the first virtually rendered feed, the second video capture feed and the second virtuallyrendered feed; and output the composite render to the display by simultaneously displaying the first virtually rendered feed and the second virtually rendered feed, wherein the first virtually rendered feed corresponds to a birdseye view of the virtual environment and the second virtually rendered feed corresponds to a flyby view of the virtual environment.18. A method for integrating a virtual rendering system and a video capture system for outputting a composite render to a display, the method comprising: receiving input data froma plurality of clients for modifying a virtual environment presented using the virtual rendering system; obtaining, from the virtual rendering system, a first virtual camera configuration of a first virtual camera in the virtual environment and a second virtual camera configuration of a second virtual camera in the virtual environment, wherein the first virtual camera configuration and the second virtual camera configuration include camera movement data including a first motion path of the first virtual camera in the virtual environment and a second motion path of the second virtual camera in the virtual environment, respectively, and wherein the first motion path tracks a path of a virtual object in motion relative to the first virtual camera and the second motion path tracks the path of the virtual object relative to the second virtual camera; programming the video capture system using the first virtual camera configuration to correspondingly control a first robotic camerain a real environment and using the second virtual camera configuration to correspondingly control a second robotic camera in the real environment; capturing, from the video capture system, a first video capture feed of the real environment using the first robotic camera and a second video capture feed of the real environment using the second robotic camera; obtaining, from the virtual rendering system, a first virtually rendered feed of the virtual environment using the first virtual camera and a second virtually rendered feed of the virtual environment using the second virtual camera, wherein the first virtually rendered feed and the second virtually rendered feed show the modifying of the virtual environment; rendering the composite render by processing the first video capture feed, the first virtually rendered feed, the second video capture feed and the second virtually rendered feed; and outputting the composite render to the display by simultaneously displaying the first virtually rendered feed and the second virtually rendered feed, wherein the first virtually rendered feed corresponds to a birdseye view of the virtual environment and the second virtually rendered feed corresponds to a flyby view of the virtual environment.