Calibration, customization, and improved user experience for bionic lenses

Number: 11099641
Published: 2021-08-24
Filed: 2019-06-27
Assignee: DISNEY ENTERPRISES, INC.
Inventors: Smithwick; Quinn Y. J., Snoddy; Jon H., Fidaleo; Douglas A.
CPC: G06T5/80; G06T7/521; A61B3/1173; G06F3/013; G06F3/012; A61B3/125; G02C7/04; A61B3/103
Verdict: Low Hardware
Source: Google Patents · FreePatentsOnline

The keeper's note

Calibration for bionic lens optical hardware (granted).

Abstract

The present disclosure relates to calibration, customization, and improved user experiences for smart or bionic lenses that are worn by a user. The calibration techniques include detecting and correcting distortion of a display of the bionic lenses, as well as distortion due to characteristics of the lens or eyes of the user. The customization techniques include utilizing the bionic lenses to detect eye characteristics that can be used to improve insertion of the bionic lenses, track health over time, and provide user alerts. The user experiences include interactive environments and animation techniques that are improved via the bionic lenses.

Background

FIELD (1) The present disclosure relates generally to bionic contact lenses worn on a user's eye. BACKGROUND (2) Bionic contact lenses, such as a smart contact lenses, that are worn or inserted into the eyes of users are quickly developing. Generally, these lenses may include circuitry and sensors that provide or generate information that can be displayed direct into the user's eye. For example, some bionic contact lenses include displays that generate images presented directly into a user's eye. Some bionic lenses also include integrated cameras that capture images from approximately the same viewpoint as the user. Many technology fields, such as alternate reality and virtual reality technologies, are looking to leverage the lenses for new applications and techniques. For example, with AR/VR applications, the display on the bionic lens generates images that can be directly overlaid with the user's “real world” vision, since the image formed by the light from the display is projected, along with light from the world, onto the user's retinas, forming the user's view. However, to operate accurately and provide an immersive user experience, the calibration and accuracy of the bionic lenses is important, current lenses may not be accurately calibrated, hindering the user experience. (3) Additionally, certain aspects of the lenses can be leveraged to further increase the user immersion, as well as provide important and useful tools for the applications utilizing bionic le

Claims

1. A system to calibrate bionic lenses configured to be positioned on an eye of a user, comprising: a replica human eye model to receive a bionic contact lens, the replica human eye model including an image sensor positioned at a focal length corresponding to an average effective human focal length; and a display that displays a calibration pattern, the display being in optical communication with the image sensor and the bionic lens; and a computer in electrical communication with the image sensor, wherein: the image sensor captures at least one calibration image corresponding to the displayed calibration pattern, the at least one calibration image corresponding to the calibration pattern as viewed through the bionic lens; and the computer compares the captured at least one calibration image to the calibration pattern as displayed and determines a distortion of the bionic lens; the computer generates a correction map for the bionic lens and transfers the correction map to the bionic lens, wherein the correction map is utilized by the bionic lens to modify an input image to an output image for display to counteract distortion introduced by an optical element. || 6. A method to calibrate bionic lenses configured to be positioned on an eye of a user comprising: positioning a bionic lens on a human eye model; projecting by a display a calibration pattern visible by the bionic lens on the human eye model; capturing by an image sensor a calibration image corresponding to the calibration pattern as viewed through the bionic lens on the human eye model; based on differences between the calibration pattern and the calibration image, determining a distortion of the bionic lens and generating a correction map for the bionic lens; and utilizing the correction map to modify an input image to an output image to correct distortion due to intrinsic properties of the bionic lens for the output image to be displayed by the bionic lens.