- Number
- 20240054689
- Published
- 2024-02-15
- Filed
- 2022-08-15
- Assignee
- Disney Enterprises, Inc.
- Inventors
- Goldberg; Evan M. et al.
- CPC
- G06F3/1423; G06F3/147; G06T11/00; G06V20/20; G06V20/46; G06V20/48; G09G3/003; G09G5/14; H04N21/44008; H04N21/47205; H04N21/8106
- Verdict
- Low Notable software
- Source
- Google Patents · FreePatentsOnline
The keeper's note
AR enhancement technique for moving images (related cluster).
Abstract
A media enhancement system includes an augmented reality (AR) device having a display, processing hardware, and a memory storing software code. The processing hardware executes the software code to monitor media content including a sequence of moving images displayed on a display screen separate from the AR device, receive playhead data indicating a playhead state of a media playout device playing out the media content, and detect, based on monitoring the media content, one or more image(s) in the sequence of moving images as one or more anchor image(s). The software code is further executed to obtain, using the anchor image(s), one or more AR effect(s) associated with the anchor image(s), and render, based on the playhead data, the AR effect(s) on the display of the AR device, wherein the AR effect(s) is/are spatially and temporally aligned with the sequence of moving images being displayed on the display screen.
Background
BACKGROUND
Advances in computer technology and software have made possible the generation of richly featured augmented reality (AR) experiences for users. AR experiences can merge virtual objects or characters with real-world features in a way that can, in principle, provide a powerfully interactive experience. AR can further be used to extend content from displays into people's homes and personal environments.
However, while AR aligned with static elements (images, planes, and objects) is common, there is a need in the art for systems and methods designed to generate AR imagery that conforms to moving images, aligning the AR imagery both spatially and temporally with those moving images.
Claims
1. A media enhancement system comprising: an augmented reality (AR) device having a display, a processing hardware, and a memory storing a software code; the processing hardware configured to execute the software code to: monitor a media content including a sequence of moving images being displayed on a display screen separate from the AR device; receive playhead data indicating a playhead state of a media playout device playing out the media content being displayed on the display screen; detect, based on monitoring the media content, at least one image in the sequence of moving images being displayed on the display screen, as at least one anchor image; obtain, using the at least one anchor image, one or more AR effects associated with the at least one anchor image; and render, based on the playhead data, the one or more AR effects on the display of the AR device, wherein the one or more AR effects are spatially and temporally aligned with the sequence of moving images being displayed on the display screen. ||
12. A method for use by a media enhancement system including an augmented reality (AR) device having a display, processing hardware, and a memory storing a software code, the method comprising: monitoring, by the software code executed by the processing hardware, a media content including a sequence of moving images being displayed on a display screen separate from the AR device; receiving, by the software code executed by the processing hardware, playhead data indicating a playhead state of a media playout device playing out the media content being displayed on the display screen; detecting, by the software code executed by the processing hardware based on monitoring the media content, at least one image included in the sequence of moving images being displayed on the display screen, as at least one anchor image; obtaining, by the software code executed by the processing hardware and using the at least one anchor image, one or more AR effects associated with the at least one anchor image; and rendering, by the software code executed by the processing hardware based on the playhead data, the one or more AR effects on the display of the AR device, wherein the one or more AR effects are spatially and temporally aligned with the sequence of moving images being displayed on the display screen.