Outer Rim Archives
Archives · 2017 · 20170064290

Application (pre-grant publication)

SYSTEMS, METHODS, AND APPARATUSES FOR STEREOSCOPIC IMAGING

Number
20170064290
Published
2017-03-02
Filed
2015-08-28
Assignee
Disney Enterprises, Inc./ETH Zürich
Inventors
Beardsley; Paul et al.
CPC
G02B17/061; G02B27/0012; G06T7/85; H04N13/243
Verdict
Medium Hardware
Source
Google Patents · FreePatentsOnline

The keeper's note

Stereoscopic imaging hardware — camera/optics apparatus for capturing stereo 3D.

Abstract

An omnidirectional camera apparatus configured to facilitate omnidirectional stereo imaging is described. The apparatus may include a first convex mirror, a first camera disposed at the first convex mirror, a second convex mirror, and a second camera disposed at the second convex mirror. The first convex mirror and the second convex mirror may be arranged such that afirst mirrored surface of the first convex mirror and a second mirrored surface of the second convex mirror may face each other. The first camera may capture imagery reflected offthe second convex mirror. The second camera may capture imagery reflected off the first convex mirror. A method of calibrating an omnidirectional camera apparatus is also described.

Background

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a side cross-sectional view of an omnidirectional stereo camera apparatus, in accordance withone or more implementations.

FIG. 2 illustrates a side cross-sectional view of the apparatus of FIG. 1 depicting field-of-view lines, in accordance with one or more implementations.

FIG. 3 illustrates a side cross-sectional view of a convex mirror used in an omnidirectional stereo camera apparatus, in accordance with one or more implementations.

FIG. 4 illustrates a top view of a convex mirror used in an omnidirectional stereo camera apparatus, in accordance with one or more implementations.

FIG. 5 illustratesa camera/mirror pair configuration used in an omnidirectional stereo camera apparatus, inaccordance with one or more implementations.

FIG. 6 illustrates another camera/mirror pair configuration used in an omnidirectional stereo camera apparatus, in accordance with one or more implementations.

FIG. 7 illustrates a method of calibrating an omnidirectional stereo camera apparatus, in accordance with one or more implementations.

FIG. 8 illustrates a setup for calibrating an omnidirectional stereo camera apparatus, including a reference object placed in the vicinity of the omnidirectional stereo camera apparatus, in accordance with one or more implementations.

FIG. 9 illustrates an image ofa first convex mirror, including a reflection of a reference object used during calibra

Claims

1. An omnidirectional stereo camera system, comprising: a first convex mirror having a first principle axis, a first mirrored surface, and a first central portion disposed along the first principle axis, the first central portion being configured to allow light to pass through the first central portion; a second convex mirror having a second principle axis, a second mirrored surface, and a second central portion disposed along the second principle axis, the second central portion being configured to allow light to pass through the second central portion, the first convex mirror and the second convex mirror being arranged such that the first principle axis and the second principle axis are aligned and such that the first mirrored surface and the second mirrored surface face each other; a first camera disposed behind the first convex mirror and aligned with the first principle axis such that light passing through the first central portion of the first convex mirror impinges on the first camera; and a second camera disposed behind the second convex mirror and aligned with the second principle axis such that light passing through the second central portion of the second convex mirror impinges on the second camera. 11. A method of calibrating an omnidirectional stereo camera apparatus, the omnidirectional stereo camera apparatus comprising a first convex mirror and a first camera disposed at the first convexmirror, a second convex mirror and a second camera disposed at the second convex mirror, the first convex mirror and the second convex mirror being arranged such that a first mirrored surface of the first convex mirror and a second mirrored surface of the second convexmirror face each other, wherein the first camera captures imagery reflected off the second convex mirror and the second camera captures imagery reflected off the first convex mirror, the method being implemented in a computer system including one or more physical processors and storage media storing machine-readable instructions, the method comprising: estimating a first system model, the first system model comprising estimations of one or more of a first shape of the first convex mirror, a first position of the first convex mirror, a second shape of the second convex mirror, a second position of the second convex mirror,a third position of the first camera, or a fourth position of the second camera; obtaining imagery captured by the first camera and the second camera depicting a reference object,the reference object being positioned in three-dimensional space adjacent the omnidirectional stereo camera, the imagery including a first image comprising a first representation of the reference object captured by the first camera and a second image comprising a second representation of the reference object captured by the second camera; determining first position information corresponding to the first representation of the reference object in the first image and second position information corresponding to the second representationof the reference object in the second image; estimating a reconstruction of the referenceobject based on the first system model, the first position information, and the second position information; reprojecting the reconstruction of the reference object onto image planes, such that the reconstruction of the reference object is reprojected onto a first plane and a second plane; determining third position information corresponding to the reprojected reference object in the first plane and fourth position information corresponding to the reprojected reference object in the second plane; and updating the system model based on the reprojections, such that the first system model is updated based on one or both of afirst difference between the first position information and the third position information, or a second difference between the second position information and the fourth position information.