DEEP IMAGE DELIGHTING

Number: 20250238898
Published: 2025-07-24
Filed: 2024-01-23
Assignee: DISNEY ENTERPRISES, INC.
Inventors: Iglesias Navarro; Santiago et al.
CPC: G06T5/50; G06T5/94; G06T5/60; G06T5/77
Verdict: Set aside generic image-relighting processing
Source: Google Patents · FreePatentsOnline

Abstract

A method for content modification executed by a computer including a processor and a memory includes receiving an initial image that includes light emitted from a representation of a light source. The method further includes analyzing the initial image, with a delighting model, to predict a second image comprising negative light of the initial image. The method further includes subtracting pixel values of the predicted second image comprising negative light of the initial image from pixel values of the initial image. The method further includes outputting a third image comprising the initial image without the emitted light from the representation of the light source. A second method includes training a delighting model with the initial image with an added predetermined light source and the predetermined light source, to predict an image comprising negative light of the initial image.

Background

FIELD

The present disclosure relates generally to systems and methods for media content modification, for example, image editing. BACKGROUND

Pictures are often captured in different lighting environments, including those with very bright and/or colored light sources (e.g., point light sources). In such cases, the light from such light sources can impact the overall content of the image, e.g., define a “halo” or “glow” around people, modify the hue of nearby objects or people, or otherwise brighten certain areas, which can obscure or adversely impact the aesthetic features of the image. For example, subjects or background objects may be modified by the light source.

Modifying or editing such images to remove a light source and/or light effects is difficult. For example, while a light source could be “dimmed” via conventional editing software, the environmental impact from the light source on the other aspects of the image will still be impacted adversely, e.g., may still include a colored effect or the like due to the light source reflecting off of the objects/subjects at the time of capture. Such light can create unwanted shadows, halo effects and other stray light of the sort that removes the realism and clarity of the image. SUMMARY

In one embodiment, a method for content modification executed by a computer including a processor and a memory is disclosed. The method includes receiving an initial image wherein the initial image includes light emit

Claims

1. A method for content modification executed by a computer including a processor and a memory comprising: receiving an initial image wherein the initial image includes light emitted from a representation of a light source; analyzing the initial image, with a delighting model, to predict a second image comprising the light emitted from the representation of the light source; subtracting pixel values of the predicted second image comprising the light emitted from the representation of the light source from pixel values of the initial image; and outputting a third image comprising the initial image without the emitted light from the representation of the light source. || 12. A method for content modification executed by a computer including a processor and a memory comprising: receiving an initial image; adding, to the initial image, a predetermined light source; training a delighting model with the initial image including the added predetermined light source and the predetermined light source, to predict a negative light image comprising only light emitted from a light source; and outputting the trained delighting model.