Outer Rim Archives
Archives · 2017 · 9736540

Granted patent

System and method for multi-device video image display and modification

Number
9736540
Published
2017-08-15
Filed
2016-10-21
Assignee
DISNEY ENTERPRISES, INC.
Inventors
Anderson; Hans C. et al.
CPC
H04N21/42204; G06F40/169; H04N5/445; H04N21/47205; H04N21/478; H04N21/4788
Verdict
Set aside multi-device video display modification - generic content sync
Source
Google Patents · FreePatentsOnline

Abstract

Methods and systems for allowing multiple devices to display and annotate (or modify) a video image are described, where a content renderer device displays a video image that is also displayed (or viewed) by one or more content viewer devices, which can both display and annotate (or modify) the same video image at the same time, and the content renderer selectively determines whether or not a GUI menu is displayed on its display screen. Annotation commands (e.g., screen touch data) on the viewer devices are captured, packaged and sent to the content renderer, which creates a combined modified video image having the annotations from the viewer devices, displays it to the renderer display and sends it to the viewer devices fordisplay thereon. Also, the viewer device may selectively display video content from multiple other peer devices as a composite video image, may annotate (or modify) each displayedvideo content independently, and may send a screen video image, or a portion thereof, to any other peer device. Any peer device may operate as a content renderer or content viewer, or both, at any given time, and peer devices may be running different operating systems.

Background

BRIEF DESCRIPTION OF THE DRAWINGS(1) FIG. 1 is a block diagram of the components of a system, in accordance with embodiments of the presentdisclosure.(2) FIG. 2 is a block diagram of the Master software application (Master App) showing various components thereof and possible interactions therebetween, in accordance with embodiments of the present disclosure.(3) FIG. 3 is a block diagram showing three peerdevices running the Master App software, one acting as a content renderer and the other two acting as content viewers, in accordance with embodiments of the present disclosure.(4)FIG. 4 is a block diagram showing four peer devices running the Master App software, which, in one example, one is acting as a content viewer and the other three are acting as content renderers, in accordance with embodiments of the present disclosure.(5) FIG. 5 is a block diagram of a video receiver logic component of the Master App software, in accordancewith embodiments of the present disclosure.(6) FIG. 6 is an illustration of a content tree having content layers and effects layers, and the creation of a compilation composition of pixels for display, in accordance with embodiments of the present disclosure.(7) FIG. 7is a block diagram of a video sender logic component of the Master App software, in accordance with embodiments of the present disclosure.(8) FIG. 8 is a screen illustration of a graphic user interface for the Master App software, in accordance with embodiments of the present dis

Claims

1. A method for modifying a displayed video image, comprising: transmitting bya content renderer device a first video image to a renderer display; transmitting a supplemented video image by the content renderer device to at least one user device, the supplemented video image having the first video image and having selected GUI control graphics, the GUI control graphics displaying options to modify the first image; receiving by the content renderer device user input data from the at least one user device indicative of a corresponding modification of the first image to be displayed on a user display of the at least one user device; wherein the user input data indicative of the modification to be displayed being intercepted in realtime prior to the user device acting on the user input data, and being sent by the user device to the content renderer device in realtime; transmitting in realtime by the content renderer device a first modified video image to the rendererdisplay, the first modified video image having the first video image and the modifications, and not having the selected GUI control graphics; transmitting in realtime by the content renderer device a second modified video image to the at least one user display, the second modified video image having the supplemented video image and the modifications; wherein the content renderer device and the user device each having a peer-sharing master software application that is adapted to provide user input data in realtime from the user deviceto the content renderer device and adapted to transmit the first and second modified video images from the content renderer device; wherein the user device receives and displays the second modified video image; and wherein a latency time between the user input data being received by the content renderer device and the user device display of the second modified video image is less than a predetermined acceptable latency time. 19. A non-transitorycomputer readable medium having a computer executable component for causing a computer system to perform a method, comprising: transmitting by a content renderer device a first video image to a renderer display; transmitting a supplemented video image by the content renderer device to at least one user device, the supplemented video image having the first video image and having selected GUI control graphics; receiving by the content renderer device user input data from the at least one user device indicative of modifications on a user display of the at least one user device; wherein the user input data indicative of the modification to be displayed being intercepted in realtime prior to the user device acting on the user input data, and being sent by the user device to the renderer device in realtime; transmitting in realtime by the content renderer device a first modified video image to the renderer display, the first modified video image having the first video image and having the modifications; transmitting in realtime by the content renderer device a second modified video image to the at least one user device, the second modified video image having the supplemented video image and the modifications; wherein the content renderer device and the user device each having a peer-sharing master software application that is adaptedto provide user input data in realtime from the user device to the content renderer device and adapted to transmit the first and second modified video images from the content renderer device; wherein the user device receives and displays the second modified video image; and wherein a latency time between the user input data being received by the content renderer device and the user device display of the second modified video image is less than apredetermined acceptable latency time. 20. A system for modifying and displaying a video image comprising: a content renderer; a renderer display; a first user device; a second user device; wherein: the first and second user devices are adapted to receive user inputs and send state data in realtime reflecting the user inputs, to the content renderer, prior to the user device acting on the respective user inputs; the content renderer is adapted to: transmit a video image to the renderer display; and transmit the video image, supplemented with a graphical user interface, to the first and second user devices, the graphical user interface displaying to a user options for modifying the video image; receive the state data reflecting the user inputs, based on options displayed by the graphical user interface, from the first and second user devices; convert in realtime the state data to instructions for modifying the video image; generate in realtime a modified video image based on the instructions; transmit in realtime the modified video image, without the graphical user interface, to the renderer display; and transmit in realtime the modified video image supplemented with the graphical user interface, to the first and second user devices; wherein the content renderer and the first and second user devices each having a peer-sharing master software application that is adapted to send in realtime the respective state data reflecting the user inputs from the respective user device to the content renderer and adapted to transmit the modified video image to the renderer display and to the first and second user devices; wherein the first and second user devices each receives and displays the modified video image supplemented with the graphical user interface on a user display of the respective first and second user devices; and wherein a latency time between the user input data being received by the content renderer and the user device display of the modified video image supplemented with the graphical user interface, is less than a predeterminedacceptable latency time.