Joint photo stream and blog post summarization and exploration

Number: 9928442
Published: 2018-03-27
Filed: 2016-03-22
Assignee: Disney Enterprises, Inc.
Inventors: Sigal; Leonid et al.
CPC: G06V20/47; G06V20/30; G06V10/7635; G06V20/70; G06V30/414; G06F18/23; G06V30/413; G06F18/2323; G06V20/62; G06F16/40
Verdict: Set aside photo-stream/blog summarization, content/social analytics
Source: Google Patents · FreePatentsOnline

Abstract

Systems, methods, and computer program products to perform an operation comprising assigning each of a plurality of images in a blog post and each of a plurality of images in a collection of images to a respective node in a graph, computing an adjacency matrix for the graph, wherein the adjacency matrix defines relationships between images in the blog post and images in the collections of images, and determining a first subset of the images in the collection of images that summarize the images in the image collection, wherein the subset is determined based on the adjacency matrix, wherein the adjacency matrix is computed based on the subset of the images in the collection of images.

Background

BACKGROUND(1) Field of the Invention(2) Embodiments disclosed herein relate to the field of computer software. More specifically, embodiments disclosed herein provide joint summarization and exploration between images in photo streams and blog posts.(3) Description of the Related Art(4) Photo streams include large collections of images captured and uploaded by users to online hosting services. The images stored in a photo stream are often unorganized, unstructured, and lack any descriptive text information. For example, a user may upload hundreds or thousands of photos from a recent vacation to a photo stream. Bloggers may create and publish blog posts that have images and associated text that portray events and/or experiences with concise sentences and representative images. For example, in a travel blog, users may write detailed stories about trips to different destinations, and select images that are representative of their trip from a larger collection of images.SUMMARY(5) Embodiments disclosed herein provide systems, methods, and computer program products to perform an operation comprising assigning each of a plurality of images in a blog post and each of a plurality of images in a collection of images to a respective node in a graph, computing an adjacency matrix for the graph, wherein the adjacency matrix defines relationships between images in the blog post and images in the collections of images, and determining a first subset of the images in the collection of image

Claims

1. A method, comprising: assigning each of a plurality of images in a blog post and each of a plurality of images in a collection of images to a respective node in a graph; computing an adjacency matrix for the graph, wherein the adjacency matrix defines relationships between images in the blog post and images in the collections of images; and determining a first subset of the images in the collection of images that summarize the images in the image collection, wherein the first subset is determined based on the adjacency matrix and the adjacency matrix is computed based on the first subset of the images in the collection of images. 9. A computer program product, comprising: a non-transitory computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code executable by a processor to perform an operation comprising: assigning each of a plurality of images in a blog post and each of a plurality of images in a collection of images to a respective node in a graph; computing an adjacency matrix for the graph, wherein the adjacency matrix defines relationships between images in the blog post and images in the collections of images; and determining a first subset of the images in the collection of images that summarize the images in the image collection, wherein the first subset is determined based on the adjacency matrix, wherein the adjacency matrix is computed based on the first subset of the images in the collection of images. 17. A system, comprising: a computer processor; and a memory containing a program which when executed by the processor performs an operation comprising: assigning each of a plurality of images in a blog post and each of a plurality of images in a collection of images to a respective node in a graph; computing an adjacency matrix for the graph, wherein the adjacency matrix defines relationships between images in the blog post and images in the collections of images; and determining a first subset of the images in the collection of images that summarize the images in the image collection, wherein the first subset is determined based on the adjacency matrix, wherein the adjacency matrix is computed based on the first subset of the images in the collection of images.