User Responsive Augmented Reality Enhancement of Moving Images

Number: 20240428474
Published: 2024-12-26
Filed: 2024-09-10
Assignee: Disney Enterprises, Inc.
Inventors: Goldberg; Evan M. et al.
CPC: G06T11/00; H04N21/4316; G06F3/1423; G06F3/1454; H04N21/44008; G06T5/94; H04N21/47205; G06T5/50; H04N21/4126; H04N21/4333
Verdict: Low Notable software
Source: Google Patents · FreePatentsOnline

The keeper's note

AR enhancement technique for moving images (continuation, related cluster).

Abstract

A system includes an augmented reality (AR) device having a first display, processing hardware, and a memory storing software code. The processing hardware is configured to execute the software code to monitor media content including a sequence of moving images displayed on a second display separate from the AR device and controlled by a media player device, detect, based on monitoring the media content, an image in the sequence of moving images for enhancement by one or more AR effects. The processing hardware further executes the software code to render the one or more AR effects on the first display, and transmit, contemporaneously with rendering the one or more AR effects on the first display, a signal configured to pause or loop the playing of the media content on the second display.

Background

BACKGROUND

Advances in computer technology and software have made possible the generation of richly featured augmented reality (AR) experiences for users. AR experiences can merge virtual objects or characters with real-world features in a way that can, in principle, provide a powerfully immersive experience. Traditional moving pictures (e.g. movies or videos played on a television screen) have become more interactive through branching narrative journeys where media segments are the result of user-specified decisions. AR synced with and controlling the playback of movies has the ability to add new layers of immersion to the storytelling experience and novels ways for the viewer to affect the narrative journey.

However, one limitation associated with conventional AR experiences is that their interactive effects tend to be self-contained, only influencing the graphics of the immediate AR scene or a nearby networked-AR scene (for multi-user experiences). A limitation with conventional branching narratives is the requirement of a very out-of-story method for viewers to make such decision (e.g., onscreen prompts and remote control button presses). Consequently, there is a need in the art for a solution enabling the provision of AR experiences across media types, as well as dynamic narratives in traditional moving pictures that are responsive to interactions with the AR experience by the user in natural, organic ways.

Claims

21: An augmented reality (AR) device comprising: a first display; a processing hardware; and a memory storing a software code; the processing hardware configured to execute the software code to: monitor playing of a first video on a second display separate from the AR device and controlled by a media player device; render one or more AR effects on the first display, based on monitoring the playing of the first video on the second display; transmit, contemporaneously with rendering the one or more AR effects on the first display, a first signal configured to pause or loop the playing of the first video on the second display; sense an interaction by a user with the AR device; and transmit, in response to sensing the interaction by the user, a second signal configured to cause playing of a second video on the second display. || 30: A method for use by an augmented reality (AR) device having a first display, the method comprising: monitoring playing of a first video on a second display separate from the AR device and controlled by a media player device; rendering one or more AR effects on the first display, based on monitoring the playing of the first video on the second display; transmitting, contemporaneously with rendering the one or more AR effects on the first display, a first signal configured to pause or loop the playing of the first video on the second display; sensing an interaction by a user with the AR device; and transmitting, in response to sensing the interaction by the user, a second signal configured to cause playing of a second video on the second display. || 39: A system for use with a first display and a second display, the system comprising: a processing hardware; and a memory storing a software code; the processing hardware configured to execute the software code to: monitor playing of a first video on the second display separate from the first display; render one or more AR effects on the first display, based on monitoring the playing of the first video on the second display; transmit, contemporaneously with rendering the one or more AR effects on the first display, a first signal configured to pause or loop the playing of the first video on the second display; sense an interaction by a user with the AR device; and transmit, in response to sensing the interaction by the user, a second signal configured to cause playing of a second video on the second display.