Dynamic scale augmented reality enhancement of images

Number: 12423883
Published: 2025-09-23
Filed: 2022-08-15
Assignee: Disney Enterprises, Inc.
Inventors: Goldberg; Evan M. et al.
CPC: G06F3/1423; G06F3/147; G06T11/10; G06T19/006; G09G3/003; G09G5/06; G09G5/14
Verdict: Low Notable software
Source: Google Patents · FreePatentsOnline

The keeper's note

Dynamic-scale AR image-enhancement technique (granted, related cluster).

Abstract

A system includes an augmented reality (AR) device having a display, processing hardware, and a memory storing software code. The processing hardware executes the software code to monitor media content including a sequence of images displayed on a display screen separate from the AR device, detect, based on monitoring the media content, an image in the sequence of images as an anchor image, and obtain, using the anchor image, one or more AR effect(s) associated with the anchor image. The processing hardware further executes the software code to determine a position and orientation of the AR device in relation to the display screen, and render, based on that position and orientation, the AR effect(s) on the display of the AR device, where the AR effect(s) include at least one intermediate scale AR effect having a scale intermediate between a display screen scale AR effect and a real-world scale AR effect.

Background

BACKGROUND (1) Advances in computer technology and software have made possible the generation of richly featured augmented reality (AR) experiences for users. AR experiences can merge virtual objects or characters with real-world features in a way that can, in principle, provide a powerfully interactive experience. AR can further be used to extend content from displays such as TV screens into people's homes and personal environments. (2) However, one limitation associated with conventional approaches to generating screen extension AR imagery is determining the appropriate scale for each AR effect. That is to say, if an AR effect conforms to the scale of a real-world object, it may not match that of the display elements. If the AR effect conforms to the scale of the display elements, the AR effect may be inappropriately sized relative to its real-world counterparts. In either instance, such mismatches significantly reduce the apparent realism of the AR enhanced content to a user. Consequently, there is a need in the art for systems and methods designed to generate augmented reality imagery having enhanced realism, such that blending of a virtual object with both display extension (e.g., TV screen extension) and real-world features presents a user with a pleasing and convincing simulation of events.

Claims

1. A system comprising: an augmented reality (AR) device having a display, a processing hardware, and a memory storing a software code; the processing hardware configured to execute the software code to: monitor a sequence of images being displayed on a display screen separate from the AR device; identify, based on monitoring the sequence of images being displayed on the display screen, an image in the sequence of images as an anchor image, wherein the anchor image is: (i) a predetermined image included in the sequence of images, or (ii) algorithmically detected from among the sequence of images during display of the sequence of images; obtain, using the anchor image, one or more AR effects associated with the anchor image; determine a position and an orientation of the AR device in relation to the display screen; and render, based on the position and the orientation of the AR device in relation to the display screen, the one or more AR effects on the display of the AR device; wherein the one or more AR effects comprise at least one intermediate scale AR effect having a scale intermediate between a display screen scale AR effect and a real-world scale AR effect. || 11. A method for use by a system including an augmented reality (AR) device having a display, processing hardware, and a memory storing a software code, the method comprising: monitoring, by the software code executed by the processing hardware, a sequence of images being displayed on a display screen separate from the AR device; identifying, by the software code executed by the processing hardware based on monitoring the sequence of images being displayed on the display screen, an image in the sequence of images as an anchor image, wherein the anchor image is: (i) a predetermined image included in the sequence of images, or (ii) algorithmically detected from among the sequence of images during display of the sequence of images; obtaining, by the software code executed by the processing hardware and using the anchor image, one or more AR effects associated with the anchor image; determining, by the software code executed by the processing hardware, a position and an orientation of the AR device in relation to the display screen; and rendering, by the software code executed by the processing hardware based on the position and the orientation of the AR device in relation to the display screen, the one or more AR effects on the display of the AR device; wherein the one or more AR effects comprise at least one intermediate scale AR effect having a scale intermediate between a display screen scale AR effect and a real-world scale AR effect.