- Number
- 11358057
- Published
- 2022-06-14
- Filed
- 2019-03-22
- Assignee
- Disney Enterprises, Inc.
- Inventors
- Smithers; Andi
- CPC
- A63F13/497; A63F13/5252; A63F13/5255; A63F13/86; G06T19/20; G06T3/16; H04N21/2187; H04N21/234345; H04N21/2365; H04N21/4312; H04N21/4781; H04N21/816; H04N21/8456
- Verdict
- Set aside interactive broadcast streaming, plumbing/business
- Source
- Google Patents · FreePatentsOnline
Abstract
Some implementations of the disclosure are directed to allowing interactive broadcast streamed video from games and other dynamic content. In accordance with some implementations, a content creator may publish a plurality of video surfaces of an environment for streaming to a plurality of client devices for video playback. The plurality of video surfaces may correspond, for example, to a cube map of a gaming environment captured from the perspective of a player. Upon receiving a stream including multiple video surfaces such as a cubemap, a media player of a viewer may generate a fully-rendered three-dimensional view of the environment.
Background
DESCRIPTION OF THE RELATED ART (1) In recent years, there has been a proliferation of streaming services that livestream video content from a publisher to many viewers. One space where livestreaming of video content has become especially popular is the esports industry where gamers livestream their video game sessions to many thousands or even millions of viewers. In some present implementations of a livestream, video of the gamer (e.g., the gamer's face) is captured and overlaid over the video output of the video game environment displayed to the video game player during a video game session. The video output of the video game environment may be displayed by rendering scene objects into multiple textures and then generating a final view that is displayed to the gamer by applying the rendered textures to the main scene. This composite video is then streamed to viewers. (2) Although video game livestreaming services allow for some limited level of interaction with other viewers (e.g., through a chat room) while viewing the livestream composite video, a viewer may feel a lack of interaction because the user may only “look” at the composite video of the stream. For example, as the viewer is limited to looking at the same view of the video game environment as the player, the viewer may be unable to view items, objects, or characters that are just off camera or behind the player that the viewer may be aware of when looking at a streaming broadcast. As such, it would be advantageou
Claims
1. A non-transitory computer readable medium having executable instructions stored thereon, that when executed by a processor, cause a system to: receive, from a server and over a communication network, a video stream including a plurality of video surfaces forming a cube map, the plurality of video surfaces captured from a point of view of a character in a virtual environment, the video stream further including a plurality of depth surfaces corresponding to the plurality of video surfaces, the plurality of video surfaces comprising: a first video surface oriented in a front direction from the character and comprising a view controlled or selected by a generator of the video stream; and a second video surface different from the first video surface and oriented along a direction that (i) extends radially outward from the character and (ii) is different from the front direction; render, at a video player, a first view of the virtual environment using the first and second video surfaces; and receive user input at the video player selecting a second view of the virtual environment to render and in response, render the second view of the virtual environment using the first video surface but not the second video surface and present the second view instead of the first view. ||
14. A non-transitory computer readable medium having executable instructions stored thereon, that when executed by a processor, cause a system to: create a plurality of video surfaces by simultaneously capturing each of a plurality of videos from a point of view of a character in a virtual environment, wherein each of the plurality of videos corresponds to one of the plurality of video surfaces, wherein the plurality of video surfaces comprises (1) a first video surface oriented in a front direction from the character and comprising a view controlled or selected, and (2) a second video surface different from the first video surface and oriented along a direction that (i) extends radially outward from the character and (ii) is different from the front direction; encode a video stream comprising the plurality of video surfaces forming a cube map and further comprising a plurality of depth surfaces corresponding to the plurality of video surfaces; and livestream the encoded video stream to a content distribution system that makes the video stream available over a communication network, wherein the encoded video stream is configured such that it is capable of being rendered by a client device to: render a first view of the virtual environment using the first and second video surfaces; and receive user input at the client device selecting a second view of the virtual environment to render and in response, render the second view of the virtual environment using the first video surface but not the second video surface and present the second view instead of the first view. ||
18. A method, comprising: receiving, over a communication network, a video stream of a plurality of video surfaces forming a cube map, the plurality of video surfaces captured from a point of view of a character in a virtual environment, the video stream further including a plurality of depth surfaces corresponding to the plurality of video surfaces, the plurality of video surfaces comprising (1) a first video surface oriented in a front direction from the character and comprising a view controlled or selected by a generator of the video stream and (2) a second video surface different from the first video surface and oriented along a direction that (i) extends radially outward from the character and (ii) is different from the front direction; preparing the plurality of video surfaces for streaming to a plurality of client devices; and after preparing the plurality of video surfaces, streaming over the communication network the plurality of video surfaces to the plurality of client devices, wherein the plurality of video surfaces are configured such that they are capable of being rendered by the plurality of client devices to: render a first view of the virtual environment using the first and second video surfaces; and receive user input selecting a second view of the virtual environment to render and in response, render the second view of the virtual environment using the first video surface but not the second video surface and present the second view instead of the first view.