Focal-length compensated AR camera hardware technique.
The present disclosure is directed to presenting a more realistic augmented reality view on a video see-through display of a device by configuring the device such that the displayed image of the real world substantially matches what would be perceived by the user if the display were not present. This may be implemented by determining one or more of: a distance from the user's eyes to the display of the device, and an angular offset between the optical axis of a rear camera of the device and the user's visual field, and using the determined distance and/or angular offset to adjust the image that is displayed to the user. The image that is displayed to the user may be adjusted by optically or digitally zooming the rear camera of the device. It may also be adjusted by tilting the rear camera or by digitally translating the displayed video feed.
TECHNICAL FIELD (1) The present disclosure relates generally to augmented reality technology. DESCRIPTION OF THE RELATED ART (2) Being immersed in augmented reality using a handheld mobile device or other augmented reality capable device, may be an engaging and unique experience. BRIEF SUMMARY OF THE DISCLOSURE (3) Techniques described herein are directed to presenting a more realistic augmented reality view on a video see-through display of a device by configuring the device such that the displayed image of the real world substantially matches what would be perceived by the user if the display were not present. (4) In one embodiment, a method includes: capturing and displaying a video feed of a real-world environment using a rear-facing camera of an augmented reality (AR) device of a user; determining a distance from a facial point of the user to a display of the AR device; based on at least the determined distance, digitally or optically zooming the video feed of the real-world environment; and after zooming the video feed, rendering an augmented reality object overlaid over the video feed. In implementations, the augmented reality device may be a handheld video see-through augmented reality device such as a smartphone or tablet. (5) In implementations, based on at least the determined distance, the rear-facing camera is optically zoomed by translating a zoom lens of the rear-facing camera. Alternatively, based on at least the determined distance, the displayed video feed m
1. A method for displaying augmented reality content to a user of an augmented reality (AR) device, the method comprising: capturing a video feed of a real-world environment, using a rear-facing camera of the AR device, wherein the rear-facing camera faces away from a face of the user; estimating a visual field of the user based on at least a position of a first eye of the user and a position of a second eye of the user relative to the AR device, using a front-facing camera that faces towards the face of the user, wherein the AR device includes a display; determining an angular offset between an optical axis of the rear-facing camera and the visual field; modifying a characteristic of the rear-facing camera based on at least the angular offset such that a display of the video feed by the AR device substantially corresponds to the visual field, wherein modifying the characteristic of the rear-facing camera comprises tilting the rear-facing camera to align the optical axis with the visual field; and rendering, on the display, an augmented reality object overlaid on the video feed, wherein the augmented reality object is registered with the real-world environment. ||
7. A device, comprising: a display; a rear-facing camera; a processor; and a non-transitory computer-readable medium having instructions stored thereon that, when executed by the processor, causes the device to: capture a video feed of a real-world environment using the rear-facing camera; display the video feed on the display; estimate a visual field of a user wearing the device based on at least a position of a first eye of the user and a position of a second eye of the user relative to the device; determine an angular offset between an optical axis of a front-facing camera and the visual field of the user; modify a characteristic of the rear-facing camera based on at least the angular offset such that the displayed video feed substantially corresponds to the visual field, wherein modifying the characteristic of the rear-facing camera comprises mechanically tilting the rear-facing camera; and render an augmented reality object overlaid over the displayed video feed, wherein the augmented reality object is registered with the real-world environment. ||
15. A method for displaying augmented reality content to a user of an augmented reality (AR) device, the method comprising: capturing and displaying a video feed of a real-world environment using a rear-facing camera of the AR device; generating a facial profile of the user by scanning a face of the user; determining, with the facial profile, a position of a first eye of the user and a position of a second eye of the user relative to a display of the AR device; based on at least the position of the first eye of the user and the position of the second eye of the user relative to the AR device, estimating a visual field of the user; determining an angular offset between an optical axis of the rear-facing camera and the visual field of the user; based on at least the angular offset, tilting the rear-facing camera to align the optical axis with the visual field to match the displayed video feed to an image of the real-world environment that would be perceived by the user without a presence of the display; and after tilting the rear-facing camera or digitally translating the video feed, rendering an augmented reality object overlaid over the video feed.