Calibration and customization for bionic lens optical hardware.
The present disclosure relates to calibration, customization, and improved user experiences for smart or bionic lenses that are worn by a user. The calibration techniques include detecting and correcting distortion of a display of the bionic lenses, as well as distortion due to characteristics of the lens or eyes of the user. The customization techniques include utilizing the bionic lenses to detect eye characteristics that can be used to improve insertion of the bionic lenses, track health over time, and provide user alerts. The user experiences include interactive environments and animation techniques that are improved via the bionic lenses.
FIELD
The present disclosure relates generally to bionic contact lenses worn on a user's eye.BACKGROUND
Bionic contact lenses, such as a smart contact lenses, that are worn or inserted into the eyes of users are quickly developing. Generally, these lenses may include circuitry and sensors that provide or generate information that can be displayed direct into the user's eye. For example, some bionic contact lenses include displays that generate images presented directly into a user's eye. Some bionic lenses also include integrated cameras that capture images from approximately the same viewpoint as the user. Many technology fields, such as alternate reality and virtual reality technologies, are looking to leverage the lenses for new applications and techniques. For example, with AR/VR applications, the display on the bionic lens generates images that can be directly overlaid with the user's “real world” vision, since the image formed by the light from the display is projected, along with light from the world, onto the user's retinas, forming the user's view. However, to operate accurately and provide an immersive user experience, the calibration and accuracy of the bionic lenses is important, current lenses may not be accurately calibrated, hindering the user experience.
Additionally, certain aspects of the lenses can be leveraged to further increase the user immersion, as well as provide important and useful tools for the applications utilizing bionic lenses
1. A system to calibrate bionic lenses configured to be positioned on an eye of a user, comprising: a replica human eye model to receive a bionic contact lens, the replica human eye model including an image sensor positioned at a focal length corresponding to an average effective human focal length; and a display that displays a calibration pattern, the display being in optical communication with the image sensor and the bionic lens; and a computer in electrical communication with the image sensor, wherein: the image sensor captures at least one calibration image corresponding to the displayed calibration pattern, the at least one calibration image corresponding to the calibration pattern as viewed through the bionic lens; and the computer compares the captured at least one calibration image to the calibration pattern as displayed and determines a distortion of the bionic lens.
4. A method to calibrate distortion of a bionic lens display comprising: displaying by an onboard display of the bionic lens a calibration pattern into an eye of a user wearing the bionic lens; capturing by an image sensor a calibration image corresponding to light exiting the eye generated by the displayed calibration pattern reflecting from a retina of the eye; and comparing by a processor the calibration image or model to the calibration pattern to determine intrinsic parameters including distortion introduced by the bionic lens; and generating by the processor a compensation map for the bionic lens to offset the distortion.
7. A method to determine eye characteristics of a user wearing one or more bionic lenses comprising: capturing by a first bionic lens worn in a first eye of the user a first image corresponding to a calibration pattern positioned at a first orientation of the user relative to the calibration pattern; capturing by the first bionic lens a second image corresponding to the calibration pattern positioned at a second orientation of the user relative to the calibration pattern; and analyzing the first image and the second image by a processor to determine the eye characteristics of the user.
12. A method to determine an inter-pupillary distance between two eyes, comprising: capturing by a bionic lens camera an image corresponding to a reflection of the two eyes on a surface; analyzing the image by a processor to detect an iris location for the two eyes; and estimating by the processor the interpupillary distance based on the detected iris location for the two eyes.
14. A system for determining physical characteristics of an object comprising: a contact lens including an image sensor and a display; and a processor in communication with the contact lens, wherein the display emits a calibration pattern that reflects on the object; the image sensor captures a calibration image of the calibration pattern as reflected on the object; and the processor compares the calibration pattern to the captured calibration image to analyze distortions of the calibration pattern and determine one or more object characteristics.
17. -
34. A method of determining a physical orientation of a user comprising: projecting light from a first bionic lens onto an object in an environment; capturing by a second bionic lens capturing one or more distorted images corresponding to the projected light reflecting from the object; analyzing the one or more distorted images, distorted light, and eye characteristic data to determine a physical orientation of the user wearing the first and second bionic lenses; and rendering content to be displayed via at least one of the first bionic lens or the second bionic lens based on the determined physical orientation of the user.
42. A method to calibrate bionic lenses configured to be positioned on an eye of a user comprising: positioning a bionic lens on a human eye model; projecting by a display a calibration pattern visible by the bionic lens on the human eye model; capturing by an image sensor a calibration image corresponding to the calibration pattern as viewed through the bionic lens on the human eye model; and based on differences between the calibration pattern and the calibration image, generating a correction map for the bionic lens.