- Number
- 20220014725
- Published
- 2022-01-13
- Filed
- 2021-09-23
- Assignee
- Disney Enterprises, Inc.
- Inventors
- MITCHELL; Kenneth J., KONIARIS; Charalampos, KOSEK; Malgorzata E., SINCLAIR; David A.
- CPC
- H04N19/103; H04N19/1883; H03M13/6572; H04N19/96; G06T9/40; H04N13/232; H04N19/12; H04N19/19; G06T17/005; H04N19/597; H04N13/161; H04N19/11; H03M13/6513
- Verdict
- Low Notable software
- Source
- Google Patents · FreePatentsOnline
The keeper's note
Real-time light-field reconstruction/depth-codec rendering technique.
Abstract
Techniques to facilitate compression of depth data and real-time reconstruction of high-quality light fields. A parameter space of values for a line, pairs of endpoints on different sides of the line, and a palette index for each pixel of a pixel tile of a depth image is sampled. Values for the line, the pairs of endpoints, and the palette index that minimize an error are determined and stored.
Background
BACKGROUND Field of the Disclosure
Aspects of the disclosure presented herein relate to image rendering and, more specifically, to a depth codec for real-time, high-quality light field reconstruction. Description of the Related Art
Recent advances in virtual and augmented reality software and hardware have sparked interest in high-quality mixed reality experiences that seamlessly blend together characters and environments. For immersive and interactive experiences that allow free user movement with six degrees of freedom, video content that is presented needs to be adapted for consumption from any point of view.
Video codec development has been strongly focused on color data, rather than depth data. However, depth estimation from color in real-time can be prohibitively expensive, and traditional video codecs have demonstrated poor performance when the amount of data to be decoded becomes large. SUMMARY
Embodiments presented in this disclosure provide a computer-implemented method, a non-transitory computer-readable medium, and a system to perform an operation that includes sampling a parameter space of values for a line, a first pair of endpoints on a first side of the line, a second pair of endpoints on a second side of the line different from the first side of the line, and a respective palette index for each pixel of a pixel tile of a depth image. The operation also includes determining, based on the sampling, values for the line, the first pair
Claims
1. A computer-implemented method comprising: sampling a parameter space of values for a line, a first pair of endpoints on a first side of the line, a second pair of endpoints on a second side of the line different from the first side of the line, and a respective palette index for each pixel of a pixel tile of a depth image; determining, based on the sampling and by operation of one or more computer processors, values for the line, the first pair of endpoints, the second pair of endpoints, and the respective palette index for each pixel that minimize an error, wherein the determined values for the respective palette index for each pixel are associated with the determined values of the first pair of endpoints or the second pair of endpoints; and storing the determined values for the line, the first pair of endpoints, the second pair of endpoints, and the respective palette index for each pixel. ||
14. A non-transitory computer-readable medium containing a program executable to perform an operation comprising: sampling a parameter space of values for a line, a first pair of endpoints on a first side of the line, a second pair of endpoints on a second side of the line different from the first side of the line, and a respective palette index for each pixel of a pixel tile of a depth image; determining, based on the sampling and by operation of one or more computer processors when executing the program, values for the line, the first pair of endpoints, the second pair of endpoints, and the respective palette index for each pixel that minimize an error, wherein the determined values for the respective palette index for each pixel are associated with the determined values of the first pair of endpoints or the second pair of endpoints; and storing the determined values for the line, the first pair of endpoints, the second pair of endpoints, and the respective palette index for each pixel. ||
18. A system comprising: one or more computer processors; a memory containing a program executable by the one or more computer processors to perform an operation comprising: sampling a parameter space of values for a line, a first pair of endpoints on a first side of the line, a second pair of endpoints on a second side of the line different from the first side of the line, and a respective palette index for each pixel of a pixel tile of a depth image; determining, based on the sampling, values for the line, the first pair of endpoints, the second pair of endpoints, and the respective palette index for each pixel that minimize an error, wherein the determined values for the respective palette index for each pixel are associated with the determined values of the first pair of endpoints or the second pair of endpoints; and storing the determined values for the line, the first pairs of endpoints, the second pair of endpoints, and the respective palette index for each pixel.