- Number
- 10275934
- Published
- 2019-04-30
- Filed
- 2017-12-20
- Assignee
- Disney Enterprises, Inc.
- Inventors
- Novak; Jan, Schroers; Christopher, Rousselle; Fabrice Pierre Armand, Fauconneau; Matthias, Sorkine Hornung; Alexander
- CPC
- G06T19/006; H04N13/117; G06T15/506; G06T15/20
- Verdict
- Medium Notable software
- Source
- Google Patents · FreePatentsOnline
The keeper's note
Augmented video rendering.
Abstract
A video rendering system includes a field-of-view detector, a display, and a computing platform including a hardware processor and a memory storing a multi-viewpoint video rendering software code. The hardware processor executes the multi-viewpoint video rendering software code to parameterize visible surfaces in a scene to define multiple texels for each visible surface, precompute one or more illumination value(s) for each texel of each visible surface, and for each texel of each visible surface, store the illumination value(s) in a cache assigned to the texel. In addition, the multi-viewpoint video rendering software code receives a perspective data from the field-of-view detector identifying one of multiple permissible perspectives for viewing the scene, and renders the scene on the display in real-time with respect to receiving the perspective data, based on the identified perspective and using one or more of the illumination value(s) precomputed for each texel of each visible surface.
Background
BACKGROUND(1) Virtual reality experiences, such as single and multi-player virtual reality games, merge video images with real physical actions in a way that can provide a powerfully interactive experience to a user. For example, a virtual reality system may utilize a head-mounted display (HMD) in combination with a tracking controller that tracks user actions, gestures, and motion in a virtual reality environment. Moreover, such a system may permit the user to move freely within the virtual reality environment and attempt to render video imagery that is responsive to the unconstrained movement of the user.(2) However, a major limitation associated with conventional virtual reality systems is that video quality tends to be inversely proportional to the freedom with which the user is permitted to move within the virtual reality environment. As such, conventional video rendering solutions are typically capable of providing cinematic or high quality video only for static user viewing perspectives.SUMMARY(3) There are provided augmented video rendering systems and methods for use by such systems, substantially as shown in and/or described in connection with at least one of the figures, and as set forth more completely in the claims.
Claims
1. A video rendering system comprising: a field-of-view detector; a display; and a computing platform coupled to the field-of-view detector and the display, the computing platform including a hardware processor and a system memory having a multi-viewpoint video rendering software code stored therein; the hardware processor configured to execute the multi-viewpoint video rendering software code to: parameterize a plurality of visible surfaces in a scene to define a plurality of texels for each of the plurality of visible surfaces; for each texel of each of the plurality of visible surfaces, precompute at least one illumination value; for each texel of each of the plurality of visible surfaces, store the at least one illumination value in a cache assigned to the texel; receive a perspective data from the field-of-view detector identifying one of a plurality of permissible perspectives for viewing the scene; and render the scene on the display in real-time with respect to receiving the perspective data, based on the one of the plurality of permissible perspectives and using at least one of the at least one illumination value precomputed for each texel of each of the plurality of visible surfaces; wherein the plurality of visible surfaces include one or more of (a)-(c): (a) at least some diffuse surfaces, wherein the at least one illumination value precomputed for each texel of each of the at least some of the diffuse surfaces comprises a single illumination value; (b) at least some distant surfaces with respect to the plurality of permissible perspectives for viewing the scene, wherein the at least one illumination value precomputed for each texel of each of the at least some of the distant surfaces comprises a plurality of illumination values inversely proportional in number to a distance of each of the at least some distant surfaces; and (c) at least some glossy surfaces, wherein the at least one illumination value precomputed for each texel of each of the at least some glossy surfaces comprises a plurality of illumination values corresponding to a reflectivity of each of the at least some of the glossy surfaces.
5. A method for use by a video rendering system including a field-of-view detector, a display, and a computing platform coupled to the field-of-view detector and the display, the computing platform including a hardware processor and a system memory having a multi-viewpoint video rendering software code stored therein, the method comprising: parameterizing, using the hardware processor, a plurality of visible surfaces in a scene to define a plurality of texels for each of the plurality of visible surfaces; for each texel of each of the plurality of visible surfaces, precomputing, using the hardware processor, at least one illumination value; for each texel of each of the plurality of visible surfaces, storing, using the hardware processor, the at least one illumination value in a cache assigned to the texel; receiving, using the hardware processor, a perspective data from the field-of-view detector identifying one of a plurality of permissible perspectives for viewing the scene; and rendering the scene on the display in real-time with respect to receiving the perspective data, using the hardware processor, based on the one of the plurality of permissible perspectives and using at least one of the at least one illumination value precomputed for each texel of each of the plurality of visible surfaces; wherein the plurality of visible surfaces include one or more of (a)-(c): (a) at least some diffuse surfaces, wherein the at least one illumination value precomputed for each texel of each of the at least some of the diffuse surfaces comprises a single illumination value; (b) at least some distant surfaces with respect to the plurality of permissible perspectives for viewing the scene, wherein the at least one illumination value precomputed for each texel of each of the at least some of the distant surfaces comprises a plurality of illumination values inversely proportional in number to a distance of each of the at least some distant surfaces; and (c) at least some glossy surfaces, wherein the at least one illumination value precomputed for each texel of each of the at least some glossy surfaces comprises a plurality of illumination values corresponding to a reflectivity of each of the at least some of the glossy surfaces.
9. A computer-readable non-transitory medium having stored thereon instructions, which when executed by a hardware processor, instantiate a method comprising: parameterizing a plurality of visible surfaces in a scene to define a plurality of texels for each of the plurality of visible surfaces; for each texel of each of the plurality of visible surfaces, precomputing at least one illumination value; for each texel of each of the plurality of visible surfaces, storing the at least one illumination value in a cache assigned to the texel; receiving a perspective data identifying one of a plurality of permissible perspectives for viewing the scene; and rendering the scene in real-time with respect to receiving the perspective data, based on the one of the plurality of permissible perspectives and using at least one of the at least one illumination value precomputed for each texel of each of the plurality of visible surfaces; wherein the plurality of visible surfaces include one or more of (a)-(c): (a) at least some diffuse surfaces, wherein the at least one illumination value precomputed for each texel of each of the at least some of the diffuse surfaces comprises a single illumination value; (b) at least some distant surfaces with respect to the plurality of permissible perspectives for viewing the scene, wherein the at least one illumination value precomputed for each texel of each of the at least some of the distant surfaces comprises a plurality of illumination values inversely proportional in number to a distance of each of the at least some distant surfaces; and (c) at least some glossy surfaces, wherein the at least one illumination value precomputed for each texel of each of the at least some glossy surfaces comprises a plurality of illumination values corresponding to a reflectivity of each of the at least some of the glossy surfaces.