Gaze based rendering for audience engagement

Number: 11189047
Published: 2021-11-30
Filed: 2019-03-11
Assignee: DISNEY ENTERPRISES, INC.
Inventors: Pan; Ye, Mitchell; Kenny
CPC: G06T7/97; G06F3/013; G06T7/248; G06T15/20; G06T7/70
Verdict: Low Notable software
Source: Google Patents · FreePatentsOnline

The keeper's note

Gaze-tracking driven rendering for audience engagement (granted).

Abstract

The present disclosure is related to an audience engagement system and method to display images on a display. The method includes detecting a gaze direction of a designated viewer, rendering a gaze object within an image on a gaze axis corresponding to the gaze direction, rendering an audience object within the image on a normal axis corresponding to a display axis, composting the audience object and the gaze object together in a composited image, and displaying the composited image on the display.

Background

FIELD (1) The present disclosure relates generally to gaze based rendering of images. BACKGROUND (2) Dynamic displays that display images or videos that interact with viewers are used in many environments, including amusement parks, advertisement displays, and entertainment venues. With two-dimensional displays, it is possible to include a character that appears to interact with the viewers, such as having eyes or other features that move to follow an animation. However, with current displays, the viewers of the display have the same view, so although there may be some viewer engagement, the engagement is shared by all viewers and not tailored to specific viewers. Additionally, flat monitors typically used with two dimensional displays can limit preservation of gaze direction due to the “Mona Lisa” effect, where the gaze of the character appears to follow a viewer regardless of viewpoint. SUMMARY (3) According to one embodiment, an audience engagement system and method to display images on a display is disclosed. The method includes determining a gaze direction of a designated viewer, rendering a gaze object within an image on a gaze axis corresponding to the gaze direction, rendering an audience object within the image on a normal axis corresponding to a display axis, compositing the audience object and the gaze object together in a composited image, and displaying the composited image on the display. (4) According to another embodiment, an interactive display method to disp

Claims

1. An audience engagement method to display images on a display comprising: determining a gaze axis corresponding to a gaze direction of a designated viewer; rendering a gaze object within an image on the gaze axis, wherein the gaze axis extends outwards from the display; rendering an audience object within the image on a normal axis corresponding to a display axis; compositing the audience object and the gaze object together to generate a composited image; and displaying the composited image on the display. || 9. An interactive display method to display images to a plurality of viewers, the method comprising: determining a first gaze image of a gaze viewer of the plurality of viewers; utilizing the first gaze image to detect a gaze direction of the gaze viewer; rendering a first image object based on the gaze direction of the gaze viewer, wherein the first image object is rendered relative to a first axis, wherein first axis extends outwards from the display; rendering a second image object relative to a second axis; and combining the first image object and the second image object into an image frame; and displaying the image frame on a display. || 15. An image display system for audience engagement comprising: a display that generates visual images; a camera that captures images of audience members; and a computer in electronic communication with the display and the camera, wherein the camera is configured to: receive a designated member image: analyze the designated member image to determine a view direction of the designated member; receive a first image frame comprising a first group of objects corresponding to an audience view and a second group of objects corresponding to a designated view; render the first group of objects on a first axis; render the second group of objects based on a second axis corresponding to the view direction of the designated member, wherein the second axis extends outwards from the display; composite the first group of objects and the second group of objects into a composite image; and transmit the composite image to the display. || 18. An image display method, comprising: rendering by a processing element a first group of objects with a normal perspective; rendering by the processing element a second group of objects with an anamorphic perspective; compositing by the processing element the first group of objects and the second group of objects into a composite image; and transmitting by the processing element the composite image to a display.