Crowd removal and automatic focus for images

Number: 12755391
Published: 2026-10-06
Filed: 2024-02-09
Assignee: Disney Enterprises, Inc.
Inventors: Iglesias Navarro; Santiago, Pernias Pascual de Pobil; Pablo, Moore; Robert B., Juboor; David N.
CPC: G06T7/11; G06T2207/10028; G06T2207/30196
Verdict: Low Notable software
First reported: 2026-W41 (2026-10-08)
Source: Google Patents · FreePatentsOnline

The keeper's note

Splits a photo into segments, uses depth data to separate subjects from bystanders, then automatically removes the crowd and focuses on the subject -- useful for cleaning up theme-park photo captures.

Abstract

A computer implemented method includes receiving, by a processor, an image including one or more subjects and one more obstructions. The method further includes partitioning, by the processor, the image into a plurality of image segments, where the one or more subjects and one or more obstructions are represented as separate image segments of the plurality of image segments. The method further includes obtaining, by the processor, depth information for the plurality of image segments. The method further includes identifying one or more focal image segments of the plurality of image segments based on the depth information of the plurality of image segments and modifying the image based on the one or more focal image segments to generate a modified image.

Background

BACKGROUND (1) Often, people may capture images at a variety of densely packed locations, such as tourist attractions and theme parks. Such images may include the subjects of interest (e.g., a family) but also include many other people and objects that also are in the area at the time of the image capture. As such, it may be desirable to remove or replace unwanted people (e.g., crowd or strangers) or objects from the image. More specifically, certain environments that are commonly suitable for photography (such as amusement parks or other tourist attractions), the high volume of guests may make it difficult to take a portrait photo without any unwanted people or obstructions in the background. Thus, it may desirable after a photo is taken to determine the focal subject(s) of the image and remove any unwanted obstructions from the image. Additionally, obstruction removal may provide better user experience for commercial portrait photography by streamlining the editing process and providing for consistent image backgrounds. (2) Current methods for removing unwanted obstructions in images are manual and require a user to manually designate objects in the image that are undesirable and select the objects for removal. These methods are time-consuming and impractical where there are many obstructions in an image. For example, for an image with a large crowd of people obstructing the background, manual methods may require selection and removal of each person in the crowd. Further, s

Claims

1. A computer implemented method comprising: receiving, by a processor, an image including one or more subjects and one or more obstructions; partitioning, by the processor, the image into a plurality of image segments, wherein combinations of the one or more subjects and the one or more obstructions are represented as separate image segments of the plurality of image segments; obtaining, by the processor, depth information for the plurality of image segments; determining a segment score of each of the plurality of image segments based on the depth information, an image segment size, and an image segment position of the plurality of image segments, wherein the segment score comprises a ranked numerical value associated with the one or more subjects and the one or more obstructions; automatically identifying one or more focal image segments of the plurality of image segments based on the segment score of each of the plurality of image segments; and modifying the image based on the one or more focal image segments to generate a modified image. || 14. An image editing system for automatic detection and editing of image obstructions, comprising: an image data storage comprising a plurality of images; and a processor configured to modify the plurality of images, wherein the processor is configured to: receive an image including one or more subjects and one or more obstructions; partition the image into a plurality of image segments, wherein combinations of the one or more subjects and the one or more obstructions are represented as separate image segments of the plurality of image segments; obtain depth information for the plurality of image segments, wherein the depth information comprises an average depth value of each of the plurality of image segments; generate a segment score of each of the plurality of image segments based on the average depth value of each of the plurality of image segments, a size of each of the plurality of image segments, and a position of each of the plurality of image segments, wherein the segment score comprises a ranked numerical value associated with the one or more subjects and the one or more obstructions; automatically identify one or more focal image segments of the plurality of image segments based on the segment score of each of the plurality of image segments; and modify the image based on the one or more focal image segments to generate a modified image.