Reconstructs opaque surfaces located behind refractive surfaces (e.g. eyes behind the cornea) from images, for realistic eye modeling.
Systems and techniques for reconstructing one or more surfaces of an object including one or more opaque surfaces behind one or more refractive surfaces are provided. The systems and techniques may include obtaining one or more images of the object including an opaque surface located behind a refractive surface and determining one or more refractive surface constraints using the one or more images. The one or more refractive surface constraints constrain one or more characteristics of the refractive surface. The systems and techniquesmay further include reconstructing an opaque surface representation or a refractive surface representation using the one or more refractive surface constraints, the opaque surfacerepresentation representing the opaque surface of the object, and the refractive surface representation representing the refractive surface of the object.
BRIEF DESCRIPTION OF DRAWINGS(1) Illustrative embodiments of the present invention are described in detail below with reference to the following drawing figures:(2) FIG. 1 illustrates a schematic of a human eye, in accordance with an embodiment of the present invention.(3) FIG. 2A illustrates an example of an eye representation generated using a low order approximation technique.(4) FIG. 2B illustrates an example of an eye representation generated using the reconstruction techniques described herein, in accordance with an embodiment of the present invention.(5) FIG. 3 illustrates an example of a system for reconstructing parts of an eye of a subject, in accordance with an embodiment of the present invention.(6) FIG. 4A illustrates an example of a system for acquiring data used in an eye reconstruction technique, in accordance with an embodiment of the present invention.(7) FIG. 4B illustrates a zoomed-in view of theexample system for acquiring data used in an eye reconstruction technique, in accordance with an embodiment of the present invention.(8) FIG. 5 illustrates an overview of a technique for reconstructing a sclera representation for a sclera part of an eye of a subject, in accordance with an embodiment of the present invention.(9) FIG. 6 illustrates an exampleof image segmentation, in accordance with an embodiment of the present invention.(10) FIG. 7 illustrates an example of sclera texturing, in accordance with an embodiment of the present invention.(11) FIG. 8 ill
1. A computer-implemented method of generating an animation model of an object, comprising: obtaining one or more images of the object, the object including an opaque surface located behind a refractive surface; determining one or more reflection constraints, one or more refraction constraints, and one or more position constraints for constraining generation of a refractive surface representation; generating the refractive surface representation by optimizinga position of the refractive surface using the one or more position constraints and by optimizing one or more surface normals of the refractive surface using the one or more reflection constraints and the one or more refraction constraints; and generating the animationmodel of the object, the animation model including the reconstructed refractive surface representation, wherein the refractive surface representation represents the refractive surface in the animation model of the object.
10. A system for generating an animation model of an object, comprising: a memory storing a plurality of instructions; and one or more processors configurable to: obtain one or more images of the object, the object including anopaque surface located behind a refractive surface; determine one or more reflection constraints, one or more refraction constraints, and one or more position constraints for constraining generation of a refractive surface representation; generate the refractive surface representation by optimizing a position of the refractive surface using the one or more position constraints and by optimizing one or more surface normals of the refractive surface using the one or more reflection constraints and the one or more refraction constraints; and generate the animation model of the object, the animation model including the reconstructed refractive surface representation, wherein the refractive surface representation represents the refractive surface in the animation model of the object.
15. A non-transitory computer-readable memory storing a plurality of instructions executable by one or more processors, the plurality of instructions comprising: instructions that cause the one or more processors to obtain one or more images of the object, the object including an opaque surface located behind a refractive surface; instructions that cause the one or more processors to determine one or more reflection constraints, one or more refraction constraints, and one or more position constraints for constraining generation of a refractive surface representation; instructions that cause the one or more processors to generating the refractive surface representation by optimizing a position of the refractive surface using the one or more position constraints and by optimizing one or more surface normals of the refractive surface using the one or more reflection constraints and the one or more refraction constraints; and instructions that cause the one or more processors to generate the animation model of the object, the animation model including the reconstructed refractive surface representation, wherein the refractive surface representation represents the refractive surface in the animation model of the object.