Systems and methods for higher order dimensional space video segmentation

Number: 9911194
Published: 2018-03-06
Filed: 2016-05-26
Assignee: Disney Enterprises, Inc.; ETH Zürich
Inventors: Hornung; Alexander Sorkine et al.
CPC: G11B27/34; G06V20/49; G11B27/3081; G11B27/28; G06T7/10
Verdict: Set aside higher-order video segmentation, editing tool
Source: Google Patents · FreePatentsOnline

Abstract

This disclosure relates to system and methods for segmenting a video in a higher order dimensional space. A video may be segmented by obtaining visual information defining an image of the video. The visual information may include pixels of the image and may be represented in a display space having a first dimensionality. A designation of a subset of the visual information represented in the display space as a part of an object portrayed in the image may be obtained. The visual information and the designation may be represented in the higher order dimensional space having a second dimensionality greater than the first dimensionality. An association of the visual information represented in the higher order dimensional space with the object may be obtained. The association may be correlated with the visual information represented in the display space. The correlation may define a location of the object in the image.

Background

FIELD(1) This disclosure relates to systems and methods for segmenting a video in a higher order dimensional space.BACKGROUND(2) An video may contain multiple objects (e.g., foreground objects, background objects, etc.). Segmenting portions of the video based on locations of objects may be time consuming and computer intensive.SUMMARY(3) This disclosure relates to segmenting a video in a higher order dimensional space. A video may be segmented by obtaining visual information defining an image of the video. The visual information may include pixels of the image and may be represented in a display space. The display space may have a first dimensionality such that the visual information represented in the display space facilitates visual reproduction of the image on a display device. A designation of a subset of the visual information represented in the display space as a part of an object portrayed in the image may be obtained. The visual information and the designation may be represented in the higher order dimensional space. The higher order dimensional space may have a second dimensionality greater than the first dimensionality. An association of the visual information represented in the higher order dimensional space with the object may be obtained based on the higher order dimensional space representation of the visual information and the designation. The association may be correlated with the visual information represented in the display space. The correlation may define

Claims

1. A system for segmenting a video in a higher order dimensional space, the system comprising: one or more processors configured by machine readable instructions to: obtain visual information defining an image of the video, wherein the visual information includes pixels of the image and is represented in a display space having a first dimensionality such that the visual information represented in the display space facilitates visual reproduction of the image on a display device; obtain a designation of a subset of the visual information represented in the display space as a part of an object portrayed in the image; represent the visual information and the designation in the higher order dimensional space, the higher order dimensional space having a second dimensionality greater than the first dimensionality; determine an association of the visual information represented in the higher order dimensional space with the object based on the higher order dimensional space representation of the visual information and the designation; and correlate the association with the visual information represented in the display space, the correlation defining a location of the object in the image. 11. A method for segmenting a video in a higher order dimensional space, the method comprising: obtaining visual information defining an image of the video, wherein the visual information includes pixels of the image and is represented in a display space having a first dimensionality such that the visual information represented in the display space facilitates visual reproduction of the image on a display device; obtaining a designation of a subset of the visual information represented in the display space as a part of an object portrayed in the image; representing the visual information and the designation in the higher order dimensional space, the higher order dimensional space having a second dimensionality greater than the first dimensionality; determining an association of the visual information represented in the higher order dimensional space with the object based on the higher order dimensional space representation of the visual information and the designation; and correlating the association with the visual information represented in the display space, the correlation defining a location of the object in the image.