METHODS AND SYSTEMS OF GENERATING A PARAMETRIC EYE MODEL

Number: 20180012401
Published: 2018-01-11
Filed: 2016-07-07
Assignee: Disney Enterprises, Inc.; ETH Zürich (Eidgenössische Technische Hochschule Zürich)
Inventors: Bérard; Pascal; Beeler; Thabo; Bradley; Derek; Gross; Markus
CPC: G06T15/04; G06T19/20
Verdict: Medium Notable software
Source: Google Patents · FreePatentsOnline

The keeper's note

Parametric eye-model generation (animation).

Abstract

Systems and techniques for generating a parametric eye model of one or more eyes are provided. The systems and techniques may include obtaining eye data from an eye model database. The eye data includes eyeball data and iris data corresponding to a plurality of eyes. The systems and techniques may further include generating an eyeball model using the eyeball data. Generating the eyeball model includes establishing correspondences among the plurality of eyes. The systems and techniques may further include generating an iris model using the iris data. Generating the iris model includes sampling one or more patches of one or more of the plurality of eyes using an iris control map and merging the one or more patches into a synthesized texture. The systems and techniques may further include generating the parametric eye model that includes the eyeball model and the iris model.

Background

FIELD

The present disclosure generally relates to generating a parametric eye model. For example, one or more parts of an eye may be captured and reconstructed using the parametric model for use in rendering an animation of an eye.BACKGROUND

Capturing faces using three-dimensional (3D) scanning techniques can be used to build face models for video games, visual effects in films, medical applications, personalized figurines, among other applications. Much research has allowed facial capture technology to achieve a high level of quality, to a point that it is oftentimes difficult to distinguish the difference between digital faces and real faces. Oftentimes, face capture research focuses on the facial skin, ignoring other important characteristics. One example is the eyes, which are an important part of the face. Techniques for producing digital doubles in computer graphics tend to give little attention to details of a subject's eye, with far less attention than capturing the rest of the face. Some efforts to focus on the eye include time consuming and uncomfortable capture set-ups for the actors.SUMMARY

Techniques and systems are described for generating and using a parametric eye model for eye capture and reconstruction. The model is a deformable model that can be morphed to represent many or all possible shapes and colors that an eye can have. By being deformable, the model succinctly captures unique variations present across the different components of the

Claims

1. A computer-implemented method of generating a parametric eye model of one or more eyes, comprising: obtaining eye data from an eye model database, the eye data including eyeball data and iris data corresponding to a plurality of eyes; generating an eyeball model using the eyeball data, wherein generating the eyeball model includes establishing correspondences among the plurality of eyes; generating an iris model using the iris data, wherein generating the iris model includes sampling one or more patches of one or more of the plurality of eyes using an iris control map and merging the one or more patches into a synthesized texture; and generating the parametric eye model, the parametric eye model including the eyeball model and the iris model. 8. A system for generating a parametric eye model of one or more eyes, comprising: a memory storing a plurality of instructions; and one or more processors configurable to: obtain eye data from an eye model database, the eye data including eyeball data and iris data corresponding to a plurality of eyes; generate an eyeball model using the eyeball data, wherein generating the eyeball model includes establishing correspondences among the plurality of eyes; generate an iris model using the iris data, wherein generating the iris model includes sampling one or more patches of one or more of the plurality of eyes using an iris control map and merging the one or more patches into a synthesized texture; and generate the parametric eye model, the parametric eye model including the eyeball model and the iris model. 15. A computer-readable memory storing a plurality of instructions executable by one or more processors, the plurality of instructions comprising: instructions that cause the one or more processors to obtain eye data from an eye model database, the eye data including eyeball data and iris data corresponding to a plurality of eyes; instructions that cause the one or more processors to generate an eyeball model using the eyeball data, wherein generating the eyeball model includes establishing correspondences among the plurality of eyes; instructions that cause the one or more processors to generate an iris model using the iris data, wherein generating the iris model includes sampling one or more patches of one or more of the plurality of eyes using an iris control map and merging the one or more patches into a synthesized texture; and instructions that cause the one or more processors to generate the parametric eye model, the parametric eye model including the eyeball model and the iris model.