Efficient stereo to multiview rendering using interleaved rendering

Number: 9565414
Published: 2017-02-07
Filed: 2013-12-18
Assignee: Disney Enterprises, Inc./ETH Zurich
Inventors: Smolic; Aljosa Aleksej Andrej et al.
CPC: H04N13/111; H04N13/139
Verdict: Low Notable software
Source: Google Patents · FreePatentsOnline

The keeper's note

Efficient stereo-to-multiview rendering technique using interleaved rendering.

Abstract

Approaches are described for generating a multiview autostereoscopic image from a stereo three-dimensional input image pair. A stereo to multiview rendering system receives a stereo three-dimensional image including a left image and a right image at a first view position and a second view position, respectively. The system generates a first input warp and a second input warp that mapsthe left image and the right image to a third and fourth positions, respectively, where the third and fourth positions lie between the first and second view positions. The system generates a plurality of output warps based on the first warp and the second warp. The system resamples each output warp in the plurality of output warps to create a plurality of partial output images. The system interleaves the plurality of partial output images to generate a composite output image.

Background

BRIEF DESCRIPTION OF THE DRAWINGS(1) So that the manner in which the above recited features of the application can be understood in detail, a more particular description of the application, briefly summarized above, may be had by reference to embodiments, some ofwhich are illustrated in the appended drawings. It is to be noted, however, that the appended drawings illustrate only typical embodiments of this application and are therefore not to be considered limiting of its scope, for the application may admit to other equally effective embodiments.(2) FIG. 1 depicts one architecture of a system within which embodiments of the present application may be implemented;(3) FIG. 2 illustrates a stereo to multiview rendering system as implemented within the display processor of FIG. 1, according to one embodiment;(4) FIG. 3 illustrates the warp interpolation stage of the stereo to multiview rendering system of FIG. 2, according to one embodiment;(5) FIG. 4 illustrates the rendering stage of the stereo to multiview rendering system of FIG. 2, according to one embodiment;(6) FIG. 5 illustrates the accumulation stage of the stereo to multiview rendering system of FIG. 2, according to one embodiment;(7) FIG. 6A illustrates the generation of interpolated and extrapolated warps using the warp interpolation unit of FIG. 3, according toone embodiment;(8) FIG. 6B illustrates one view in an interleaved pattern for displaying images on a multiview autostereoscopic display, according to one em

Claims

1. A method for generating a multiview autostereoscopic image, comprising: receiving a stereo three-dimensional image comprising a left image at a first view position and a right image at a second view position; generating a first input warp that maps the left image to a third view position that lies between the first view position and the second view position; generating a second input warp that maps the right image to a fourth view position that lies between the first view position and the second view position; generating a plurality of output warps based on the first input warpand the second input warp; resampling each output warp in the plurality of output warps to create a plurality of partial output images; and interleaving the plurality of partial output images to generate a composite output image. 12. A non-transitory computer-readable medium including instructions that, when executed by a processor, cause the processor to generate a multiview autostereoscopic image, by performing an operation comprising: receiving a stereo three-dimensional image comprising a left image at a first view position and aright image at a second view position; generating a first input warp that maps the left image to a third view position that lies between the first view position and the second view position; generating a second input warp that maps the right image to a fourth view position that lies between the first view position and the second view position; generating a plurality of output warps based on the first input warp and the second input warp; resampling each output warp in the plurality of output warps to create a plurality of partial output images; and interleaving the plurality of partial output images to generate a composite output image. 20. A computing system, comprising: a memory that is configured to store instructions for a program; and a processor that is configured to generate a multiview autostereoscopic image, by performing an operation comprising: receiving a stereo three-dimensional image comprising a left image at a first view position and a right image at a secondview position; generating a first input warp that maps the left image to a third view position that lies between the first view position and the second view position; generating asecond input warp that maps the right image to a fourth view position that lies between the first view position and the second view position; generating a plurality of output warps based on the first input warp and the second input warp; resampling each output warp in the plurality of output warps to create a plurality of partial output images; and interleaving the plurality of partial output images to generate a composite output image.