JOINT PHOTO STREAM AND BLOG POST SUMMARIZATION AND EXPLORATION

Number: 20170277970
Published: 2017-09-28
Filed: 2016-03-22
Assignee: Disney Enterprises, Inc.
Inventors: SIGAL; Leonid et al.
CPC: G06V30/414; G06V20/30; G06V20/62; G06F18/2323; G06V10/7635; G06F18/23; G06V20/70; G06F16/40; G06V20/47; G06V30/413
Verdict: Set aside photo/blog summarization - content search
Source: Google Patents · FreePatentsOnline

Abstract

Systems, methods, and computer program products to perform an operation comprising assigning each of a plurality of images in a blog post and each of a plurality of images in a collection of images to a respective node in a graph, computing an adjacency matrix for the graph, wherein the adjacency matrix defines relationships between images in the blog post and images in the collections of images, and determining a first subset of the images in the collection of images that summarize the imagesin the image collection, wherein the subset is determined based on the adjacency matrix, wherein the adjacency matrix is computed based on the subset of the images in the collection of images.

Background

BRIEF DESCRIPTION OF THE DRAWINGS

So that the manner in whichthe above recited aspects are attained and can be understood in detail, a more particulardescription of embodiments of the invention, briefly summarized above, may be had by reference to the appended drawings.

It is to be noted, however, that the appended drawings illustrate only typical embodiments of this invention and are therefore not to be considered limiting of its scope, for the invention may admit to other equally effective embodiments.

FIG. 1 illustrates an example of a computing environment that provides joint photo stream and blog post summarization and exploration, according to one embodiment.

FIG. 2 further illustrates the enhancement platform first shown in FIG. 1, according toone embodiment.

FIG. 3 illustrates an example of alignments between blogs and photostreams and an example of a photo stream summary, according to one embodiment.

FIGS. 4A-4C illustrate examples of joint photo stream and blog post summarization and exploration, according to various embodiments.

FIG. 5 illustrates a method for joint photo stream and blog post summarization and exploration, according to one embodiment.

FIG.6 illustrates a method for preprocessing image streams and blog posts, according to one embodiment.

FIG. 7 illustrates a method to jointly determine a summarization of photostreams and an alignment from blog images to images of photo streams, according to

Claims

1. A method, comprising: assigning each of a plurality of images in a blog post and each of a plurality of images in a collection of images to a respectivenode in a graph; computing an adjacency matrix for the graph, wherein the adjacency matrix defines relationships between images in the blog post and images in the collections of images; and determining a first subset of the images in the collection of images that summarize the images in the image collection, wherein the subset is determined based on the adjacency matrix and the adjacency matrix is computed based on the subset of the images in the collection of images. 9. A computer program product, comprising: a computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code executable by a processor to perform an operation comprising: assigning each of a plurality of images in a blog post and each of a plurality of images in a collection of images to a respective node in a graph; computing an adjacency matrix for the graph, wherein the adjacency matrix defines relationships between images in the blog post and images in the collections of images; and determining a first subset of the images in the collection of images that summarize the images in the image collection, wherein the subset is determined based on the adjacency matrix, wherein the adjacency matrix is computed based on the subset of the images in the collection of images. 17. A system, comprising: a computer processor; and a memory containing a program which when executed by the processor performs an operation comprising: assigning each of a plurality of images in a blog post and each of a plurality of images in a collection of images to a respective node in a graph; computing an adjacency matrix for the graph, wherein the adjacency matrix defines relationships between images in the blog post and images in the collections of images; and determining a first subset of the images in the collection of images that summarize the images in the image collection, wherein the subset is determined based on the adjacency matrix, wherein the adjacency matrix is computed based on the subset of the images in the collection of images.