- Number
- 12322006
- Published
- 2025-06-03
- Filed
- 2022-08-15
- Assignee
- Disney Enterprises, Inc.
- Inventors
- Goldberg; Evan M. et al.
- CPC
- G06F3/1423; G06F3/147; G06T11/00; G06V20/20; G06V20/46; G06V20/48; G09G3/003; G09G5/14; H04N21/44008; H04N21/47205; H04N21/8106
- Verdict
- Low Notable software
- Source
- Google Patents · FreePatentsOnline
The keeper's note
AR enhancement technique for moving images (granted, dup cluster).
Abstract
A media enhancement system includes an augmented reality (AR) device having a display, processing hardware, and a memory storing software code. The processing hardware executes the software code to monitor media content including a sequence of moving images displayed on a display screen separate from the AR device, receive playhead data indicating a playhead state of a media playout device playing out the media content, and detect, based on monitoring the media content, one or more image(s) in the sequence of moving images as one or more anchor image(s). The software code is further executed to obtain, using the anchor image(s), one or more AR effect(s) associated with the anchor image(s), and render, based on the playhead data, the AR effect(s) on the display of the AR device, wherein the AR effect(s) is/are spatially and temporally aligned with the sequence of moving images being displayed on the display screen.
Background
BACKGROUND (1) Advances in computer technology and software have made possible the generation of richly featured augmented reality (AR) experiences for users. AR experiences can merge virtual objects or characters with real-world features in a way that can, in principle, provide a powerfully interactive experience. AR can further be used to extend content from displays into people's homes and personal environments. (2) However, while AR aligned with static elements (images, planes, and objects) is common, there is a need in the art for systems and methods designed to generate AR imagery that conforms to moving images, aligning the AR imagery both spatially and temporally with those moving images.
Claims
1. An augmented reality (AR) device for use in an environment including a display screen located physically separate and apart from the AR device, the AR device comprising: an AR display; a memory storing a software code; and a processing hardware configured to execute the software code to: monitor a media content including a sequence of moving images being displayed on the display screen located physically separate and apart from the AR device; receive playhead data indicating a playhead state of a media playout device playing out the media content being displayed on the display screen located physically separate and apart from the AR device; detect, based on monitoring the media content being displayed on the display screen, at least one image in the sequence of moving images being displayed on the display screen, as at least one anchor image; obtain, using the at least one anchor image, one or more AR effects associated with the at least one anchor image; and render, based on the playhead data, the one or more AR effects on the AR display of the AR device, wherein the one or more AR effects are spatially and temporally aligned with the sequence of moving images being displayed on the display screen located physically separate and apart from the AR device. ||
12. A method for use by an augmented reality (AR) device in an environment including a display screen located physically separate and apart from the AR device, the AR device having a display, processing hardware, and a memory storing a software code, the method comprising: monitoring, by the software code executed by the processing hardware, a media content including a sequence of moving images being displayed on the display screen located physically separate and apart from the AR device; receiving, by the software code executed by the processing hardware, playhead data indicating a playhead state of a media playout device playing out the media content being displayed on the display screen located physically separate and apart from the AR device; detecting, by the software code executed by the processing hardware based on monitoring the media content being displayed on the display screen, at least one image in the sequence of moving images being displayed on the display screen, as at least one anchor image; obtaining, by the software code executed by the processing hardware and using the at least one anchor image, one or more AR effects associated with the at least one anchor image; and rendering, by the software code executed by the processing hardware based on the playhead data, the one or more AR effects on the AR display of the AR device, wherein the one or more AR effects are spatially and temporally aligned with the sequence of moving images being displayed on the display screen located physically separate and apart from the AR device.