Signaling warp maps using a high efficiency video coding (HEVC) extension for 3D video coding

Number: 10757391
Published: 2020-08-25
Filed: 2018-06-25
Assignee: Disney Enterprises, Inc.
Inventors: Smolic; Aljosa, Stefanoski; Nikolce
CPC: G06T3/18; H04N13/161; H04N13/178; H04N13/261; H04N13/271; H04N19/54; H04N19/597; H04N19/70
Verdict: Set aside HEVC video coding extension, codec plumbing
Source: Google Patents · FreePatentsOnline

Abstract

Techniques are disclosed for view generation based on a video coding scheme. A bitstream is received that is encoded based on the video coding scheme. The bitstream includes video, quantized warp map offsets, and a message of a message type specified by the video coding scheme. Depth samples decoded from the first bitstream are interpreted as quantized warp map offsets, based on a first syntax element contained in the message. Warp maps are generated based on the quantized warp map offsets and a second syntax element contained in the message. Views are generated using image-domain warping and based on the video and the warp maps.

Background

BACKGROUNDField of the Invention(1) Human beings typically see using stereoscopic vision. The left and right eyes of an observer each perceives slightly different views of a scene, and the brain of the observer fuses the slightly different views into a single image that provides depth information. The depth information allows the observer to perceive the relative distance to various objects in the scene. Movies filmed with a single camera may not provide such depth information to the viewer and thus tend to look flat.(2) Early efforts in 3-D movie technology used anaglyphs, in which two images of the same scene, with a relative offset between them, are superimposed on a single piece of movie film, with the images being subject to complimentary color filters (e.g., red and green). Viewers donned special glasses so that one image would be seen only by the left eye while the other would be seen only by the right eye. When the brains of the viewers fused the two images, the result was the illusion of depth. In the 1950s, “dual-strip” projection techniques were widely used to show 3-D movies. Using dual-strip projection techniques, two films were projected side-by-side in synchronism, with the light from each projector being oppositely polarized. Viewers wore polarizing glasses, and each eye would see only one of the two images. More recently, active polarization has been used to distinguish left-eye and right-eye images. Left-eye and right-eye images are projected sequentially us

Claims

1. A computer-implemented method of view generation, the computer-implemented method comprising: receiving a first bitstream including video; upon determining that the first bitstream includes a designation to use image-domain warping; generating one or more warp maps by operation of one or more computer processors and based on (i) one or more warp map offsets decoded from the first bitstream and (ii) one or more warp map attributes included in the first bitstream; and generating one or more views based on (i) the video and (ii) the one or more warp maps, wherein the one or more views are generated using the image-domain warping based on the designation. 16. A non-transitory computer-readable medium containing a program, which when executed is configured to perform an operation for view generation, the operation comprising: receiving a first bitstream including video; determining that the first bitstream includes a designation to use image-domain warping; generating one or more warp maps by operation of one or more computer processors when executing the program, and based on (i) one or more warp map offsets decoded from the first bitstream and (ii) one or more warp map attributes included in the first bitstream; and generating one or more views based on (i) the video and (ii) the one or more warp maps, wherein the one or more views are generated using the image-domain warping based on the designation. 21. A system for view generation, the system comprising: one or more computer processors; and a memory containing a program, which when executed by the one or more computer processors performs an operation comprising: receiving a first bitstream including video; upon determining that the first bitstream includes a designation to use image-domain warping; generating one or more warp maps based on (i) one or more warp map offsets decoded from the first bitstream and (ii) one or more warp map attributes included in the first bitstream; and generating one or more views based on (i) the video and (ii) the one or more warp maps, wherein the one or more views are generated using the image-domain warping based on the designation. 26. A computer-implemented method of view generation, the computer-implemented method comprising: generating, by operation of one or more computer processors, a first bitstream including video; and transmitting the first bitstream to a receiving entity configured to: determine that the first bitstream includes a designation to use image-domain warping; generate one or more warp maps based on (i) one or more warp map offsets decoded from the first bitstream and (ii) one or more warp map attributes included in the first bitstream; and generate one or more views based on (i) the video and (ii) the one or more warp maps, wherein the one or more views are generated using the image-domain warping based on the designation.