Systems and Methods for Creating an Immersive Video Content Environment

Number: 20200092536
Published: 2020-03-19
Filed: 2019-11-22
Assignee: DISNEY ENTERPRISES, INC.
Inventors: Watson; Scott F., Smoot; Lanny S.
CPC: H04N21/00; G06T15/20; H04N13/366; G06T7/579; G06T17/00; G06F3/011; G06T7/246
Verdict: Low Notable software
Source: Google Patents · FreePatentsOnline

The keeper's note

Immersive video rendering technique for synthetic scene views.

Abstract

There is provided a system including a non-transitory memory storing an executable code and a hardware processor executing the code to receive a video content including a plurality of frames showing a scene from a perspective of a real camera, create a three-dimensional (3D) model of the scene using the plurality of frames, store the 3D model of the scene in the non-transitory memory, construct a synthetic view of the scene showing additional perspectives from one or more virtual cameras at one or more locations in the scene, transmit the synthetic view of the scene for being displayed on a display, display a scene of the video content on the display, track a position of a viewer moving in a room, and adjust the display of the scene being displayed on the display based on the position of the viewer in the room relative to the display.

Background

BACKGROUND

In the past, television displays projected video content onto a convex display using cathode ray tubes. Recent developments in television displays have introduced flat screen displays with substantially higher resolution than conventional cathode ray tube televisions, and further developments have introduced concave television displays. Concave, or curved, displays show content on a screen that is slightly curved towards the viewer, bringing the displayed image into the viewer's peripheral vision. However, images displayed on a conventional display, or even a flat screen display, do not allow the viewer to feel immersed in the video content, because even with the recent advances in technology, the images remain substantially the same when viewed from any position in a viewing area, such as a movie theater or a room.SUMMARY

The present disclosure is directed to immersive interactive video systems, substantially as shown in and/or described in connection with at least one of the figures, as set forth more completely in the claims.

Claims

21. A system comprising: a non-transitory memory storing an executable code; a hardware processor executing the executable code to: receive a video content including a plurality of frames showing a scene from a perspective of a real camera; create a three-dimensional (3D) model of the scene using the plurality of frames; store the 3D model of the scene in the non-transitory memory; construct a synthetic view showing the scene from a first perspective of a virtual camera at a first location in the scene; transmit the synthetic view of the scene for being displayed on a display located at a fixed position in a room; dynamically adjust the synthetic view to show the scene from a second perspective of the virtual camera at a second location in the scene different from the first location in the scene, wherein the dynamically adjusted synthetic view of the scene is an angularly accurate display of the scene; and transmit the dynamically adjusted synthetic view of the scene for being displayed on the display, such that the scene appears on the display as if the real camera recording the scene was located at the second location. 31. A method for use with a system having a non-transitory memory and a hardware processor, the method comprising: receiving, using the hardware processor, a video content including a plurality of frames showing a scene from a perspective of a real camera; creating, using the hardware processor, a three-dimensional (3D) model of the scene using the plurality of frames; storing the 3D model of the scene in the non-transitory memory; constructing, using the hardware processor, a synthetic view showing the scene from a first perspective of a virtual camera at a first location in the scene; transmitting, using the hardware processor, the synthetic view of the scene for being displayed on a display located at a fixed position in a room; dynamically adjusting, using the hardware processor, the synthetic view to show the scene from a second perspective of the virtual camera at a second location in the scene different from the first location in the scene, wherein the dynamically adjusted synthetic view of the scene is an angularly accurate display of the scene; and transmitting, using the hardware processor, the dynamically adjusted synthetic view of the scene for being displayed on the display, such that the scene appears on the display as if the real camera recording the scene was located at the second location.