- Number
- 10783704
- Published
- 2020-09-22
- Filed
- 2018-09-27
- Assignee
- Disney Enterprises, Inc.
- Inventors
- Mitchell; Kenneth J., Dümbgen; Frederike, Liu; Shuang
- CPC
- G06T15/503; G06N3/09; G06N3/0464; G06T7/50; G06T17/10; G06N3/08; G06T17/20; G06T7/251
- Verdict
- Low Notable software
- Source
- Google Patents · FreePatentsOnline
The keeper's note
CV dense 3D reconstruction from narrow-baseline motion (granted).
Abstract
Techniques for constructing a three-dimensional model of facial geometry are disclosed. A first three-dimensional model of an object is generated, based on a plurality of captured images of the object. A projected three-dimensional model of the object is determined, based on a plurality of identified blendshapes relating to the object. A second three-dimensional model of the object is generated, based on the first three-dimensional model of the object and the projected three dimensional model of the object.
Background
BACKGROUNDField of the Invention(1) Aspects of the present disclosure relate to reconstruction of a three-dimensional model of an object using two dimensional images, and more specifically, though not exclusively, to reconstruction of dense geometry from small camera or target object movement.Description of the Related Art(2) Estimating three-dimensional structures from two dimensional image sequences, sometimes referred to as structure-from-motion, traditionally requires large camera movements with large angle variation. That is, using traditional techniques, a three-dimensional model for a target object can be estimated using a series of two dimensional images of the object, but creation of an accurate three-dimensional model requires large variations in the location of the target object in the two dimensional images. Many digital cameras can capture a series of two dimensional images in a short window of time, for example capturing a burst of frames surrounding the primary image. But traditional structure-from-motion techniques are not suitable for generating an accurate three-dimensional model using these bursts of two dimensional images, because the movement of the camera and the target object is typically very slight (e.g., from accidental movement by the photographer or target), and so the images do not provide the desired large variations in the location of the target object. This can result in high depth uncertainty.SUMMARY(3) Embodiments described herein include a m
Claims
1. A method, comprising: generating, using one or more computer processors, a first three-dimensional model of an object based on a plurality of captured images of the object; determining, using the one or more computer processors, a projected three-dimensional model of the object based on a plurality of identified blendshapes relating to the object; identifying one or more unreliable values, relating to at least one of color or depth, in the first three-dimensional model by comparing one or more first values, relating to at least one of color or depth, in the first three-dimensional model with one or more second values, relating to at least one of color or depth, in the projected three-dimensional model; and generating, using the one or more computer processors, a second three-dimensional model of the object correcting the first three-dimensional model, by excluding the one or more unreliable values from the first three-dimensional model.
10. A computer program product comprising: a non-transitory computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code executable by one or more computer processors to perform an operation, the operation comprising: generating a first three-dimensional model of an object based on a plurality of captured images of the object; determining a projected three-dimensional model of the object based on a plurality of identified blendshapes relating to the object; identifying one or more unreliable values, relating to at least one of color or depth, in the first three-dimensional model by comparing one or more first values, relating to at least one of color or depth, in the first three-dimensional model with one or more second values, relating to at least one of color or depth, in the projected three-dimensional model; and generating a second three-dimensional model of the object, correcting the first three-dimensional model, by excluding the one or more unreliable values from the first three-dimensional model.
15. A system, comprising: a processor; and a memory storing a program, which, when executed on the processor, performs an operation, the operation comprising: generating a first three-dimensional model of an object based on a plurality of captured images of the object; determining a projected three-dimensional model of the object based on a plurality of identified blendshapes relating to the object; identifying one or more unreliable values, relating to at least one of color or depth, in the first three-dimensional model by comparing one or more first values, relating to at least one of color or depth, in the first three-dimensional model with one or more second values, relating to at least one of color or depth, in the projected three-dimensional model; and generating a second three-dimensional model of the object, correcting the first three-dimensional model, by excluding the one or more unreliable values from the first three-dimensional model.