Outer Rim Archives
Archives · 2021 · 10924823

Granted patent

Cloud-based image rendering for video stream enrichment

Number
10924823
Published
2021-02-16
Filed
2019-08-26
Assignee
Disney Enterprises, Inc.
Inventors
Binder; Evan A., Martin; Marc Junyent, Badia Pujol; Jordi, Swerdlow; Avner, Farre Guiu; Miquel Angel
CPC
H04N21/4722; H04L65/70; H04L65/65; H04N21/25891; G06T15/005; H04N21/8545; H04L67/02; H04N21/234345; H04N21/25858; H04N21/8456; H04N21/858
Verdict
Set aside cloud video streaming enrichment, plumbing
Source
Google Patents · FreePatentsOnline

Abstract

According to one implementation, a cloud-based system for performing cloud-based image rendering for video stream enrichment includes a video forwarding unit and a video enrichment unit. The video forwarding unit is configured to detect one or more non-interactive video player(s) linked to the video forwarding unit over a communication network, forward a video stream to the non-interactive video player(s), and forward the video stream to the video enrichment unit. The video enrichment unit is configured to receive the video stream, detect one or more interactive video player(s) linked to the video enrichment unit over the communication network, identify a video enhancement corresponding to one or more customizable video segment(s) in the video stream, insert a rendered video enhancement into the one or more customizable video segment(s) to produce an enriched video stream, and distribute the enriched video stream to one or more of the interactive video player(s).

Background

BACKGROUND (1) Mobile streaming applications on most personal communication devices, such as smartphones and tablet computers, for example, are typically not optimized for sophisticated graphical interactivity enabled by video game engines, but instead rely on native software stacks designed to support video streaming. As a result, it is often challenging to later include an interactive experience built for a game engine into a streaming application executed on a mobile device. (2) One conventional technique for including an interactive experience built for a game engine into a streaming application has been to develop a container solution that allows game engine based applications to reside within native video streaming applications built for a particular platform. However, containers are typically expensive to implement due to their relatively high initial build cost, a recurring cost for every feature or experience that is included in the container, and the additional processing overhead required to run each experience. (3) Another conventional solution is to create an entirely separate application for interactive experiences. However, this potential solution risks product and brand confusion for users, and also results in increased costs associated with marketing and customer acquisition, as well as application support and maintenance. Moreover, mobile interactivity may be limited by the processing capacity of the mobile devices themselves, which tends to be significantly

Claims

1. A cloud-based system comprising: a video forwarding computer configured to: detect, over a communication network, at least one non-interactive video player linked to the video forwarding computer; forward, over the communication network, a video stream to the at least one non-interactive video player, wherein the video stream includes at least one predetermined video segment and at least one customizable video segment; and concurrently with forwarding the video stream to the at least one non-interactive video player, forward, over the communication network, the video stream to a video enrichment computer; the video enrichment computer configured to: receive, over the communication network, the video stream from the video forwarding computer; detect, over the communication network, at least one interactive video player linked to the video enrichment computer; start streaming, over the communication network, the at least one predetermined video segment of the video stream received from the video forwarding computer to the at least one interactive video player; while streaming the at least one predetermined video segment of the video stream received from the video forwarding computer to the at least one interactive video player: identify a video enhancement corresponding to the at least one customizable video segment in the video stream received from the video forwarding computer; insert a rendered video enhancement into the at least one customizable video segment of the video stream received from the video forwarding computer to produce a customized video segment; and continue streaming, over the communication network, the video stream, including the customized video segment, to the at least one interactive video player. || 11. A method for use by a cloud-based system including a video forwarding computer and a video enrichment computer, the method comprising: detecting, over a communication network, by the video forwarding computer, at least one non-interactive video player linked to the video forwarding computer; forwarding, over the communication network, by the video forwarding computer, a video stream to the at least one non-interactive video player, wherein the video stream includes at least one predetermined video segment and at least one customizable video segment; concurrently with forwarding the video stream to the at least one non-interactive video player, forwarding, over the communication network, by the video forwarding computer, the video stream to a video enrichment computer; receiving, over the communication network, by the video enrichment computer, the video stream from the video forwarding computer; detecting, over the communication network, by the video enrichment computer, at least one interactive video player linked to the video enrichment computer; starting to stream, over the communication network, the at least one predetermined video segment of the video stream received from the video forwarding computer to the at least one interactive video player; while streaming the at least one predetermined video segment of the video stream received from the video forwarding computer to the at least one interactive video player: identifying, by the video enrichment computer, a video enhancement corresponding to the at least one customizable video segment in the video stream received from the video forwarding computer; inserting, by the video enrichment computer, a rendered video enhancement into the at least one customizable video segment of the video stream received from the video forwarding computer to produce a customized video segment stream; and continuing to stream, over the communication network, by the video enrichment computer, the video stream, including the customized video segment, to the at least one interactive video player.