Outer Rim Archives
Archives · 2019 · 10264329

Granted patent

Descriptive metadata extraction and linkage with editorial content

Number
10264329
Published
2019-04-16
Filed
2014-10-28
Assignee
Disney Enterprises, Inc.
Inventors
Accardo; Anthony M. et al.
CPC
H04N21/4622; H04N21/234; H04N21/8352; H04N21/44008; H04N21/4722; H04N21/8133; H04N21/23418; H04N21/8358; H04N21/6581; H04N21/4316; H04N21/84; H04N21/4725; H04N21/233; H04N21/4394
Verdict
Set aside descriptive metadata extraction/linkage editorial content, content management
Source
Google Patents · FreePatentsOnline

Abstract

Embodiments provide techniques for distributing supplemental content based on content entities within video content. Embodiments include receiving video data containing an embedded watermark at a first position within the video data. The embedded watermark is detected at the first position within the video data. Embodiments also include transmitting, to a remote content server, a message specifying a time stamp corresponding to the first position within the video data. In response to transmitting the message, supplemental content corresponding to a content entity depicted within the video content at the first position within the video content is received from the remote content server. Embodiments also include outputting the video data for display together with at least an indication of the supplemental content.

Background

BACKGROUNDField of the Invention(1) The present disclosure relates to providing media content, and more specifically, to techniques for embedding data within video content for use in retrieving supplemental content corresponding to a content entity depicted within the video content.Description of the Related Art(2) A number of different techniques exist today for delivering video content to users. Generally speaking, existing systems for delivering video content, such as over-the-air broadcasts, cable television service, Internet television service, telephone network television service, satellite television service, satellite radio service, websites, etc., provide a relatively impersonalized, generic experience to all viewers. For example, with respect to broadcast television, all viewers of a given television network station receive essentially the same content in essentially the same order.(3) In addition to providing the video content to users, content providers can also provide supplemental content that corresponds to content entities shown in the video content. For instance, a particular scene of the video content could show a particular actor playing a particular fictional character, and supplemental content about the particular fictional character could be provided along with the video content. For example, such supplemental content could include concept art and a biography for the fictional character. Moreover, such supplemental content can be shown for other content

Claims

1. A computer-implemented method, comprising: receiving, at a client device, video data for a first instance of video content and containing an indication that supplemental content is available for a character in a scene depicted within frames of the video content at a first position within the video data, the indication comprising a watermark embedded at the first position within the video data, wherein the character in the scene was automatically detected via at least one of a temporal consistency enhancement operation and an object/character segmentation refinement operation; responsive to the client device detecting the embedded watermark at the first position within the video data, dynamically determining, during playback of the video data and without requiring user action, a timestamp that identifies the first position within the video data where the embedded watermark was detected; transmitting, to a remote content server, a message specifying (i) a content identifier uniquely identifying the first instance of video content, (ii) the timestamp that identifies the first position within the video data at which the embedded watermark was detected and (iii) a client identifier that uniquely identifies the client device; in response to transmitting the message, receiving, from the remote content server, supplemental content corresponding to the character, wherein the remote content server is configured to: determine the character by accessing a mapping data structure that contains a mapping between a data value pair and the character, wherein the data value pair specifies (i) the content identifier that uniquely identifies the first instance of video content and (ii) the timestamp corresponding to the first position within the first instance of video content; determine the supplemental content to transmit to the client device, by selecting a portion of supplemental content having a predefined association with the character, wherein the selection is made based on a device profile corresponding to the client identifier for the client device; and transmit the supplemental content to the client device; and outputting the video data for display together with at least an indication of the supplemental content. 6. A non-transitory computer-readable medium containing program code that, when executed by operation of one or more computer processors, performs an operation comprising: receiving, at a client device, video data for a first instance of video content and containing an indication that supplemental content is available for a character in a scene depicted within frames of the video content at a first position within the video data, the indication comprising a watermark embedded at the first position within the video data, wherein the character in the scene was automatically detected via at least one of a temporal consistency enhancement operation and an object/character segmentation refinement operation; responsive to the client device detecting the embedded watermark at the first position within the video data, dynamically determining, during playback of the video data and without requiring user action, a timestamp that identifies the first position within the video data where the embedded watermark was detected; transmitting, to a remote content server, a message specifying (i) a content identifier uniquely identifying the first instance of video content, (ii) the timestamp that identifies the first position within the video data at which the embedded watermark was detected and (iii) a client identifier that uniquely identifies the client device; in response to transmitting the message, receiving, from the remote content server, supplemental content corresponding to the character, wherein the remote content server is configured to: determine the character by accessing a mapping data structure that contains a mapping between a data value pair and the character, wherein the data value pair specifies (i) the content identifier that uniquely identifies the first instance of video content and (ii) the timestamp corresponding to the first position within the first instance of video content; determine the supplemental content to transmit to the client device, by selecting a portion of supplemental content having a predefined association with the character, wherein the selection is made based on a device profile corresponding to the client identifier for the client device; and transmit the supplemental content to the client device; and outputting the video data for display together with at least an indication of the supplemental content. 11. A system, comprising: a computer processor; and a memory containing a program that, when executed by the computer processor, performs an operation comprising: receiving, at a client device, video data for a first instance of video content and containing an indication that supplemental content is available for a character in a scene depicted within frames of the video content at a first position within the video data, the indication comprising a watermark embedded at the first position within the video data, wherein the character in the scene was automatically detected via at least one of a temporal consistency enhancement operation and an object/character segmentation refinement operation; responsive to the client device detecting the embedded watermark at the first position within the video data, dynamically determining, during playback of the video data and without requiring user action, a timestamp that identifies the first position within the video data where the embedded watermark was detected; transmitting, to a remote content server, a message specifying (i) a content identifier uniquely identifying the first instance of video content, (ii) the timestamp that identifies the first position within the video data at which the embedded watermark was detected and (iii) a client identifier that uniquely identifies the client device; in response to transmitting the message, receiving, from the remote content server, supplemental content corresponding to the character, wherein the remote content server is configured to: determine the character by accessing a mapping data structure that contains a mapping between a data value pair and the character, wherein the data value pair specifies (i) the content identifier that uniquely identifies the first instance of video content and (ii) the timestamp corresponding to the first position within the first instance of video content; determine the supplemental content to transmit to the client device, by selecting a portion of supplemental content having a predefined association with the character, wherein the selection is made based on a device profile corresponding to the client identifier for the client device; and transmit the supplemental content to the client device; and outputting the video data for display together with at least an indication of the supplemental content.