- Number
- 10299012
- Published
- 2019-05-21
- Filed
- 2014-10-28
- Assignee
- Disney Enterprises, Inc.
- Inventors
- Accardo; Anthony M. et al.
- CPC
- H04N21/8358; H04N21/6581; H04N21/23418; G06V20/70; H04N21/8133
- Verdict
- Set aside descriptive metadata extraction/linkage editorial content grant dup
- Source
- Google Patents · FreePatentsOnline
Abstract
Embodiments provide techniques for distributing supplemental content based on content entities within video content. Embodiments include analyzing video data to identify a known content entity within two or more frames of the video data. For each of the two or more frames, a region of pixels within the respective frame is determined that corresponds to the known content entity. Embodiments further include determining supplemental content corresponding to the known content entity. A watermark is embedded at a first position within the video data, such that the watermark corresponds to an identifier associated with the determined supplemental content. Upon receiving a message specifying the identifier, embodiments include transmitting the supplement content to a client device for output together with the video data.
Background
BACKGROUND(1) Field of the Invention(2) The present disclosure relates to providing media content, and more specifically, to techniques for embedding data within video content for use in retrieving supplemental content corresponding to a content entity depicted within the video content.(3) Description of the Related Art(4) A number of different techniques exist today for delivering video content to users. Generally speaking, existing systems for delivering video content, such as over-the-air broadcasts, cable television service, Internet television service, telephone network television service, satellite television service, satellite radio service, websites, etc., provide a relatively impersonalized, generic experience to all viewers. For example, with respect to broadcast television, all viewers of a given television network station receive essentially the same content in essentially the same order.(5) In addition to providing the video content to users, content providers can also provide supplemental content that corresponds to content entities shown in the video content. For instance, a particular scene of the video content could show a particular actor playing a particular fictional character, and supplemental content about the particular fictional character could be provided along with the video content. For example, such supplemental content could include concept art and a biography for the fictional character. Moreover, such supplemental content can be shown for other
Claims
1. A computer-implemented method, comprising: analyzing video data for a first instance of video content in order to identify a character in a scene depicted within two or more of a plurality of frames of the video data, including performing a temporal consistency enhancement operation across the plurality frames of the video data; determining, for each of the two or more frames, a region of pixels within the respective frame that correspond to the identified character, including performing an object/character segmentation refinement operation across the two or more frames of the video data; generating a mapping data structure that contains a mapping between a data value pair and the identified character, wherein the data value pair specifies (i) a content identifier that uniquely identifies the first instance of video content and (ii) a timestamp corresponding to a first position within the first instance of video content where the character was identified; embedding a watermark at the first position within the video data; and upon receiving, from a remote client device, a message specifying (i) the content identifier that uniquely identifies the first instance of video content (ii) the timestamp corresponding to the first position within the first instance of video content and (iii) a client identifier that uniquely identifies the remote client device, wherein the timestamp was determined by the remote client device based on the remote client device detecting the embedded watermark at the first position within the video data and without requiring user action: determining the character by accessing the mapping data structure using the timestamp and the content identifier specified within the received message; determining supplemental content to transmit to the remote client device, by selecting a portion of supplemental content having a predefined correspondence with the character, wherein the selection is made based on a device profile corresponding to the client identifier for the remote client device; and transmitting the supplemental content corresponding to the character to the remote client device, for output together with the video data. |
9. A non-transitory computer-readable medium containing program code that, when executed by operation of one or more computer processors, performs an operation comprising: analyzing video data for a first instance of video content to identify a character in a scene depicted within two or more of a plurality of frames of the video data, including performing a temporal consistency enhancement operation across the plurality frames of the video data; determining, for each of the two or more frames, a region of pixels within the respective frame that correspond to the identified character, including performing an object/character segmentation refinement operation across the two or more frames of the video data; generating a mapping data structure that contains a mapping between a data value pair and the identified character, wherein the data value pair specifies (i) a content identifier that uniquely identifies the first instance of video content and (ii) a timestamp corresponding to a first position within the first instance of video content where the character was identified; embedding a watermark at the first position within the video data; and upon receiving, from a remote client device, a message specifying (i) a content identifier that uniquely identifies the first instance of video content (ii) the timestamp corresponding to the first position within the first instance of video content and (iii) a client identifier that uniquely identifies the remote client device, wherein the timestamp was determined by the remote client device based on the remote client device detecting the embedded watermark at the first position within the video data and without requiring user action: determining the character by accessing the mapping data structure using the timestamp and the content identifier specified within the received message; determining supplemental content to transmit to the remote client device, by selecting a portion of supplemental content having a predefined association correspondence with the character, wherein the selection is made based on a device profile corresponding to the client identifier for the remote client device; and transmitting the supplemental content corresponding to the character to the remote client device, for output together with the video data. |
14. A system, comprising: one or more computer processors; and a memory containing a program that, when executed by the one or more computer processors, performs an operation comprising: analyzing video data for a first instance of video content to identify a character in a scene depicted within two or more of a plurality of frames of the video data, including performing a temporal consistency enhancement operation across the plurality frames of the video data; determining, for each of the two or more frames, a region of pixels within the respective frame that correspond to the identified character, including performing an object/character segmentation refinement operation across the two or more frames of the video data; generating a mapping data structure that contains a mapping between a data value pair and the identified character, wherein the data value pair specifies (i) a content identifier that uniquely identifies the first instance of video content and (ii) a timestamp corresponding to a first position within the first instance of video content where the character was identified; embedding a watermark at the first position within the video data; and upon receiving, from a remote client device, a message specifying (i) a content identifier that uniquely identifies the first instance of video content (ii) the timestamp corresponding to the first position within the first instance of video content and (iii) a client identifier that uniquely identifies the remote client device, wherein the timestamp was determined by the remote client device based on the remote client device detecting the embedded watermark at the first position within the video data and without requiring user action: determining the character by accessing the mapping data structure using the timestamp and the content identifier specified within the received message; determining supplemental content to transmit to the remote client device, by selecting a portion of supplemental content having a predefined correspondence with the character, wherein the selection is made based on a device profile corresponding to the client identifier for the remote client device; and transmitting the supplemental content corresponding to the character to the remote client device, for output together with the video data.