User responsive augmented reality enhancement of moving images

Number: 12131405
Published: 2024-10-29
Filed: 2022-08-15
Assignee: Disney Enterprises, Inc.
Inventors: Goldberg; Evan M. et al.
CPC: G06T11/00; H04N21/47205; H04N21/44008; H04N21/4126; G06F3/1454; H04N21/4316; G06F3/1423; G06T5/94; G06T5/50; H04N21/4333
Verdict: Low Notable software
Source: Google Patents · FreePatentsOnline

The keeper's note

AR enhancement technique for moving images (granted, related cluster).

Abstract

A system includes an augmented reality (AR) device having a first display, processing hardware, and a memory storing software code. The processing hardware is configured to execute the software code to monitor media content including a sequence of moving images displayed on a second display separate from the AR device and controlled by a media player device, detect, based on monitoring the media content, an image in the sequence of moving images for enhancement by one or more AR effects. The processing hardware further executes the software code to render the one or more AR effects on the first display, and transmit, contemporaneously with rendering the one or more AR effects on the first display, a signal configured to pause or loop the playing of the media content on the second display.

Background

BACKGROUND (1) Advances in computer technology and software have made possible the generation of richly featured augmented reality (AR) experiences for users. AR experiences can merge virtual objects or characters with real-world features in a way that can, in principle, provide a powerfully immersive experience. Traditional moving pictures (e.g. movies or videos played on a television screen) have become more interactive through branching narrative journeys where media segments are the result of user-specified decisions. AR synced with and controlling the playback of movies has the ability to add new layers of immersion to the storytelling experience and novels ways for the viewer to affect the narrative journey. (2) However, one limitation associated with conventional AR experiences is that their interactive effects tend to be self-contained, only influencing the graphics of the immediate AR scene or a nearby networked-AR scene (for multi-user experiences). A limitation with conventional branching narratives is the requirement of a very out-of-story method for viewers to make such decision (e.g., onscreen prompts and remote control button presses). Consequently, there is a need in the art for a solution enabling the provision of AR experiences across media types, as well as dynamic narratives in traditional moving pictures that are responsive to interactions with the AR experience by the user in natural, organic ways.

Claims

1. A system comprising: an augmented reality (AR) device having a first display, a processing hardware, and a memory storing a software code; the processing hardware configured to execute the software code to: monitor playing of media content including a sequence of moving images being displayed on a second display separate from the AR device and controlled by a media player device; detect, based on monitoring the media content being played on the second display, an image in the sequence of moving images for enhancement by one or more AR effects; render the one or more AR effects on the first display; and transmit, contemporaneously with rendering the one or more AR effects on the first display, a signal configured to pause or loop the playing of the media content on the second display. || 11. A method for use by a system including an augmented reality (AR) device having a first display, processing hardware, and a memory storing a software code, the method comprising: monitoring, by the software code executed by the processing hardware, playing of media content including a sequence of moving images being displayed on a second display separate from the AR device and controlled by a media player device; detecting, by the software code executed by the processing hardware based on monitoring the media content being played on the second display, an image in the sequence of moving images for enhancement by one or more AR effects; rendering, by the software code executed by the processing hardware, the one or more AR effects on the first display; and transmitting, by the software code executed by the processing hardware contemporaneously with rendering the one or more first AR effects on the first display, a signal configured to pause or loop the playing of the media content on the second display. || 21. An augmented reality (AR) device for use with a media player device, the AR device comprising: a first display; a processing hardware; and a memory storing a software code; the processing hardware configured to execute the software code to: monitor playing of media content including a sequence of moving images being displayed on a second display separate from the AR device and controlled by the media player device; detect, based on monitoring the media content being played on the second display, an image in the sequence of moving images for enhancement by one or more AR effects; render the one or more AR effects on the first display; and transmit, contemporaneously with rendering the one or more AR effects on the first display, a signal configured to pause or loop the playing of the media content on the second display.