Detail reconstruction for SDR-HDR conversion

Number: 11468548
Published: 2022-10-11
Filed: 2020-08-27
Assignee: Disney Enterprises, Inc.
Inventors: Zhang; Yang, Aydin; Tunc
CPC: G06T5/20; G06T5/50; G06T5/60; G06T5/77; G06T5/92; G06T9/002
Verdict: Set aside generic HDR image conversion, no creative hook
Source: Google Patents · FreePatentsOnline

Abstract

The exemplary embodiments relate to converting standard dynamic range (SDR) content to high dynamic range (HDR) content. An SDR image may be decomposed into a base layer of the SDR image that includes low frequency information from the SDR image and a detail layer of the SDR image that includes high frequency information from the SDR image. A base layer of an HDR image may be generated using the base layer of the SDR image and a detail layer of the HDR image may be generated using the detail layer of the SDR image. An HDR image is then generated using the base layer of the HDR image and the detail layer of the HDR image.

Background

BACKGROUND INFORMATION (1) A display device may support Standard Dynamic Range (SDR) content and High Dynamic Range (HDR) content. Compared to SDR content, HDR content may support a greater dynamic range of luminosity, more contrast and a wider range of colors. Therefore, HDR content may provide a better viewing experience. (2) In SDR content some visual details may be clipped due to quantization and insufficient dynamic range. Typically, the clipping occurs around highlights and has an adverse effect on the viewing experience of the SDR content. To provide an example, clipped highlights may lose high-frequency texture information at their brightest spots where the texture is replaced by a uniform colored region. To provide another example, the low-frequency luminance profile of the highlight is altered due to clipping. In addition to the adverse effects clipping may have on the visual presentation of SDR content, the clipped details also present a challenge for SDR to HDR conversion.

Claims

1. A method comprising: receiving a standard dynamic range (SDR) image; decomposing the SDR image into a base layer of the SDR image and a detail layer of the SDR image; processing the base layer of the SDR image using a first neural network to generate a base layer of a high dynamic range (HDR) image; generating a mask; processing the mask and the detail layer of the SDR image using a second neural network to generate a coarse inpainting output used for generating a detail layer of the HDR image; combining the base layer of the HDR image and the detail layer of the HDR image to generate a combined HDR output; and processing the combined HDR output using a third fully neural network to generate the HDR image. || 8. A device comprising: a communication interface; and a processor configured to perform operations, the operations comprising: receiving a standard dynamic range (SDR) image; decomposing the SDR image into a base layer of the SDR image and a detail layer of the SDR image; processing the base layer of the SDR image using a first neural network to generate a base layer of a high dynamic range (HDR) image; generating a mask; processing the mask and the detail layer of the SDR image using a second neural network to generate a coarse inpainting output used for generating a detail layer of the HDR image; combining the base layer of the HDR image and the detail layer of the HDR image to generate a combined HDR output; and processing the combined HDR output using a third fully neural network to generate the HDR image.