- Number
- 10665023
- Published
- 2020-05-26
- Filed
- 2017-12-26
- Assignee
- DISNEY ENTERPRISES, INC.
- Inventors
- Patel; Mehul, Chapman; Steven M., Havey; Benjamin F., Popp; Joseph
- CPC
- G06T19/006; G06T7/571
- Verdict
- Low Notable software
- Source
- Google Patents · FreePatentsOnline
The keeper's note
Technique for improved AR content generation.
Abstract
Systems, devices, and methods are disclosed for generating improved AR content. An electronic device includes circuitry coupled to a memory storing instructions that, when executed, cause the circuitry to obtain frame data for a frame captured using a camera. The frame data includes a level of focus for one or more frame objects in the frame. The circuitry is caused to associate an augmented reality object with at least one of the one or more frame objects. The circuitry is caused to determine a fit factor between a level of focus of the augmented reality object and level of focus of the at least one of the frame objects associated with the augmented reality object. Additionally, the circuitry is caused to, if the fit factor does not satisfy a threshold, apply a decrease to the level of focus of the augmented reality object in order to generate an increased fit factor.
Background
BACKGROUND(1) Cameras, such as video cameras and still cameras, can be used to capture an image, a series of images, or a video of a physical, real-world scene. Certain devices, by way of an augmented reality (AR) application or functionality, may be configured to insert virtual objects into the captured images or video before and/or while the images or video are displayed.SUMMARY(2) Some systems for providing augmented reality (AR) content are limited because inserted AR objects do not match or fit with the appearance of nearby or associated objects in an image, and hence such AR objects do not appear realistic in the context of the image. In such systems, where AR objects are not modified to better match or fit with the appearance of nearby objects, the AR objects may be distracting, i.e., draw a viewer's eye in a manner that is undesirable.(3) In view of the above shortcomings in certain systems, there is a need for a platform that provides improved augmented reality content, including in some examples, by setting or modifying a level of focus of an augmented reality object, where the level of focus is set/modified to better match, fit with, or relate to that of frame objects in the image into which the AR object is inserted. In particular, there is a need for such platforms that enable control over characteristics of the AR object, including for example where such control and modification of the AR object is implemented on the fly during or in connection with the capture
Claims
1. An electronic device for generating improved augmented reality content, the electronic device comprising: a camera configured to capture a first frame; an augmented reality component coupled to the camera and a memory, wherein the memory stores instructions that, when executed, cause the augmented reality component to: obtain frame data for the first frame, the frame data comprising a three-dimensional marker associated with a location in the first frame; using the three-dimensional marker, determine an expected perceived depth of a frame object in the first frame; insert an augmented reality object into the first frame at the location, wherein a focus level of the augmented reality object is set to a default depth value; based on the location in the first frame, group the augmented reality object with the frame object in the first frame; modify the focus level of the augmented reality object to an approximate perceived depth, wherein the approximate perceived depth of the augmented reality object corresponds with the expected perceived depth of the frame object in the first frame; and while the camera is capturing a second frame, display the first frame and the augmented reality object to increase a fit between the focus level of the augmented reality object and the frame object are grouped with the augmented reality object.
8. A method for generating improved augmented reality content, the method comprising: generating a focus map using frame data for a first frame, the frame data comprising a frame object associated with a location in the first frame; using the focus map, determining an expected perceived depth of the frame object in the first frame; inserting an augmented reality object into the first frame at the location, wherein a focus level of the augmented reality object is set to a default depth value; based on the location in the first frame, grouping the augmented reality object with the frame object in the first frame; modifying the focus level of focus of the augmented reality object to an approximate perceived depth, wherein the approximate perceived depth of the augmented reality object corresponds with the expected perceived depth of the frame object in the first frame; and while a second frame is captured, displaying the first frame and the augmented reality object to cause a modification to the focus level of the augmented reality object.
16. An electronic device for generating improved augmented reality content, the electronic device comprising circuitry coupled to a memory, wherein the memory stores instructions that, when executed, cause the circuitry to: obtain frame data for a first frame, the frame data comprising a three-dimensional marker associated with a location in the first frame; using the three-dimensional marker, determine an expected perceived depth of a frame object in the first frame; insert an augmented reality object into the first frame at the location, wherein a focus level of the augmented reality object is set to a default depth value; based on the location in the first frame, associate the augmented reality object with the frame object in the first frame; determine a fit factor between the focus level of the augmented reality object and the expected perceived depth of the frame object in the first frame; responsive to the fit factor not satisfying a threshold, modify the focus level of the augmented reality object to an approximate perceived depth, wherein the approximate perceived depth of the augmented reality object corresponds with the expected perceived depth of the frame object in the first frame; and generate a second fit factor between the modified focus level of the augmented reality object and the approximate perceived depth.