Techniques are disclosed for view generation based on a video coding scheme. A bitstream is received that is encoded based on the video coding scheme.The bitstream includes video, quantized warp map offsets, and a message of a message typespecified by the video coding scheme. Depth samples decoded from the first bitstream are interpreted as quantized warp map offsets, based on a first syntax element contained in the message. Warp maps are generated based on the quantized warp map offsets and a second syntax element contained in the message. Views are generated using image-domain warping and based on the video and the warp maps.
BRIEF DESCRIPTION OF THE DRAWINGS(1) So that the manner in which the above recited features presented in this disclosure can be understood in detail, a more particular description, briefly summarized above, may be had by reference to embodiments, some of which are illustrated in the appended drawings. It is to be noted, however, that the appended drawings illustrate only typical embodiments presented in this disclosure and are therefore not to be considered limiting of its scope, for the disclosure may admit to other equally effective embodiments.(2) FIG. 1 is a data flow diagram illustrating a system for view generation based on a video coding scheme, according to one embodiment presented in this disclosure.(3) FIG. 2 depicts a syntax for a supplementary enhancement information (SEI) message, according to one embodiment presented in this disclosure.(4) FIG. 3 depicts pseudocode to derive a warp map from decoded depth samples and syntax elements provided by the SEI message, according to one embodiment presented in this disclosure.(5) FIG. 4 illustrates exemplary camera positions and associated warp maps, according to one embodiment presented in this disclosure.(6) FIG. 5 depicts pseudocode to derive a warp map used to synthesize a view at an arbitrary position using an input view at a different position, according to one embodiment presented in this disclosure.(7) FIG. 6 is a flowchart depicting a method for view generation based on the video coding scheme, according to one e
1. A computer-implemented method of view generation based on a video coding scheme, the computer-implemented method comprising: receiving a first bitstream encoded based on the video coding scheme, the first bitstream including video and a first message of a predefined message type specified by the video coding scheme, the first message containing a plurality of syntax elements; and upon determining that the plurality of syntax elements includes an image-domain-warping designator that causes image-domain warping based on decoded warp map offsets in lieu of a depth-image-based-rendering designator that causes depth-image-based rendering based on decoded depth maps: decoding one or more warp map offsets from the first bitstream and by operation of one or more computer processors; generating one or more warp maps based on: (i) the one or morewarp map offsets decoded from the first bitstream and (ii) one or more warp map attributes included in the plurality of syntax elements; and generating one or more views using image-domain warping and based on: (i) the video and (ii) the one or more warp maps.
14. A non-transitory computer-readable medium containing a program, which when executed is configured to perform an operation for view generation based on a video coding scheme, the operation comprising: receiving a first bitstream encoded based on the video coding scheme, the first bitstream including video and a first message of a predefined message type specifiedby the video coding scheme, the first message containing a plurality of syntax elements; and upon determining that the plurality of syntax elements includes an image-domain-warping designator that causes image-domain warping based on decoded warp map offsets in lieu ofa depth-image-based-rendering designator that causes depth-image-based rendering based ondecoded depth maps: decoding one or more warp map offsets from the first bitstream and byoperation of one or more computer processors when executing the program; generating one or more warp maps based on: (i) the one or more warp map offsets decoded from the first bitstream and (ii) one or more warp map attributes included in the plurality of syntax elements; and generating one or more views using image-domain warping and based on: (i) the video and (ii) the one or more warp maps.
17. A system for view generation based on a video coding scheme, the system comprising: one or more computer processors; and a memory containing a program, which when executed by the one or more computer processors is configured to perform an operation comprising: receiving a first bitstream encoded based on the video coding scheme, the first bitstream including video and a first message of a predefined message type specified by the video coding scheme, the first message containing a plurality of syntax elements; and upon determining that the plurality of syntax elements includes an image-domain-warping designator that causes image-domain warping based on decoded warp map offsets in lieu of a depth-image-based-rendering designator that causes depth-image-based rendering based on decoded depth maps: decoding one or more warp map offsets from the firstbitstream; generating one or more warp maps based on: (i) the one or more warp map offsets decoded from the first bitstream and (ii) one or more warp map attributes included in the plurality of syntax elements; and generating one or more views using image-domain warping and based on: (i) the video and (ii) the one or more warp maps.
20. A computer-implemented method of view generation based on a video coding scheme, the computer-implemented method comprising: generating, by operation of one or more computer processors, a first bitstream encoded based on the video coding scheme, the first bitstream including video and a first message of a predefined message type specified by the video coding scheme, the first message containing a plurality of syntax elements; and transmitting the first bitstream to a receiving entity configured to, upon determining that the plurality of syntax elements includes an image-domain-warping designator that causes image-domain warping based on decoded warp map offsets in lieu of a depth-image-based-rendering designator that causes depth-image-based rendering based on decoded depth maps: decode one or more warp map offsets from the first bitstream; generate one or more warp maps based on: (i) the one or more warp map offsets decoded from the first bitstream and (ii) one or more warp map attributes included in the plurality of syntax elements; and generate one or more views using image-domainwarping and based on: (i) the video and (ii) the one or more warp maps.