SIGNALING WARP MAPS USING A HIGH EFFICIENCY VIDEO CODING (HEVC) EXTENSION FOR 3D VIDEO CODING

Number: 20180309975
Published: 2018-10-25
Filed: 2018-06-25
Assignee: Disney Enterprises, Inc.
Inventors: SMOLIC; Aljosa et al.
CPC: G06T3/18; H04N13/161; H04N13/178; H04N13/261; H04N13/271; H04N19/54; H04N19/597; H04N19/70
Verdict: Set aside HEVC 3D video-coding extension (PGPUB dup)
Source: Google Patents · FreePatentsOnline

Abstract

Techniques are disclosed for view generation based on a video coding scheme. A bitstream is received that is encoded based on the video coding scheme. The bitstream includes video, quantized warp map offsets, and a message of a message type specified by the video coding scheme. Depth samples decoded from the first bitstream are interpreted as quantized warp map offsets, based on a first syntax element contained in the message. Warp maps are generated based on the quantized warp map offsets and a second syntax element contained in the message. Views are generated using image-domain warping and based on the video and the warp maps.

Background

BACKGROUNDField of the Invention

Human beings typically see using stereoscopic vision. The left and right eyes of an observer each perceives slightly different views of a scene, and the brain of the observer fuses the slightly different views into a single image that provides depth information. The depth information allows the observer to perceive the relative distance to various objects in the scene. Movies filmed with a single camera may not provide such depth information to the viewer and thus tend to look flat.

Early efforts in 3-D movie technology used anaglyphs, in which two images of the same scene, with a relative offset between them, are superimposed on a single piece of movie film, with the images being subject to complimentary color filters (e.g., red and green). Viewers donned special glasses so that one image would be seen only by the left eye while the other would be seen only by the right eye. When the brains of the viewers fused the two images, the result was the illusion of depth. In the 1950s, “dual-strip” projection techniques were widely used to show 3-D movies. Using dual-strip projection techniques, two films were projected side-by-side in synchronism, with the light from each projector being oppositely polarized. Viewers wore polarizing glasses, and each eye would see only one of the two images. More recently, active polarization has been used to distinguish left-eye and right-eye images. Left-eye and right-eye images are projected sequentia

Claims

21. A computer-implemented method of view generation, the computer-implemented method comprising: receiving a first bitstream including video and a first message; upon determining that the first message includes an image-domain-warping designator, generating one or more warp maps by operation of one or more computer processors and based on: (i) one or more warp map offsets decoded from the first bitstream and (ii) one or more warp map attributes; and generating one or more views using image-domain warping and based on: (i) the video and (ii) the one or more warp maps. 24. A non-transitory computer-readable medium containing a program, which when executed is configured to perform an operation for view generation, the operation comprising: receiving a first bitstream including video and a first message; upon determining that the first message includes an image-domain-warping designator, generating one or more warp maps by operation of one or more computer processors when executing the program, and based on: (i) one or more warp map offsets decoded from the first bitstream and (ii) one or more warp map attributes; and generating one or more views using image-domain warping and based on: (i) the video and (ii) the one or more warp maps. 27. A system for view generation, the system comprising: one or more computer processors; and a memory containing a program, which when executed by the one or more computer processors performs an operation comprising: receiving a first bitstream including video and a first message; upon determining that the first message includes an image-domain-warping designator, generating one or more warp maps based on: (i) one or more warp map offsets decoded from the first bitstream and (ii) one or more warp map attributes; and generating one or more views using image-domain warping and based on: (i) the video and (ii) the one or more warp maps. 30. A computer-implemented method of view generation, the computer-implemented method comprising: generating, by operation of one or more computer processors, a first bitstream including video and a first message; and transmitting the first bitstream to a receiving entity configured to: upon determining that the first message includes an image-domain-warping designator, generate one or more warp maps based on: (i) one or more warp map offsets decoded from the first bitstream and (ii) one or more warp map attributes; and generate one or more views using image-domain warping and based on: (i) the video and (ii) the one or more warp maps.

Claims truncated at the source; see the full document.