Situationally Aware Social Agent

Number: 20220398428
Published: 2022-12-15
Filed: 2021-06-11
Assignee: Disney Enterprises, Inc.
Inventors: Kumar; Komath Naveen, Kennedy; James R., Papon; Jeremie A., Fidaleo; Douglas A.
CPC: H04L67/12; G06F3/167; G10L25/51; H04W4/021; H04W4/21; G10L21/0208; G06N5/04; G06N20/00; G10L17/00; G10L21/0272; G06N3/006
Verdict: Low Notable software
Source: Google Patents · FreePatentsOnline

The keeper's note

Situation-aware interactive social agent/character AI.

Abstract

A system for providing a situationally aware social agent includes processing hardware and a memory storing a software code. The processing hardware executes the software code to receive radar data and audio data, process the radar data and the audio data to obtain radar-based location data and audio-based location data each corresponding to a location of one or more user(s), and process the radar data and the audio data to obtain radar-based venue data and audio-based venue data each corresponding to an environment surrounding the user(s). The software code further determines, using the radar-based location data and the audio-based location data, the location of the user(s), determines, using the radar-based venue data and the microphone-based venue data, the environment surrounding the user(s), and identifies, based on the location and the environment, an interactive expression for use by the situationally aware social agent to interact with the user(s).

Background

BACKGROUND

Advances in artificial intelligence have led to the development of a variety of devices providing dialogue-based interfaces that simulate social agents. However, typical shortcomings of conventional social agents include the inability to engage in natural, fluid conversations, the inability to engage with more than one person at a time, and the failure to respond to environmental cues. Moreover, although existing social agents offer some degree of user personalization, for example tailoring responses to an individual user's characteristics or preferences, that personalization remains limited by their fundamentally transactional design. That is to say, their transactional functionality makes it unnecessary for conventional social agents to remember more than a limited set of predefined keywords, such as user names and basic user preferences. Thus, there is a need in the art for an automated solution for providing a situationally aware social agent capable of interacting with multiple users concurrently in a natural and attentive manner.

Claims

1. A system comprising: a processing hardware; and a memory storing a software code; the processing hardware configured to execute the software code to: receive radar data and audio data; process the radar data and the audio data to obtain radar-based location data and audio-based location data each corresponding to a location of at least one user; process the radar data and the audio data to obtain radar-based venue data and audio-based venue data each corresponding to an environment surrounding the at least one user; determine, using the radar-based location data and the audio-based location data, the location of the at least one user; determine, using the radar-based venue data and the microphone-based venue data, the environment surrounding the at least one user; and identify, based on the location and the environment, an interactive expression for use by a social agent to interact with the at least one user. || 14. A method for use by a system including a processing hardware and a memory storing a software code, the method comprising: receiving, by the software code executed by the processing hardware, radar data and audio data; processing, by the software code executed by the processing hardware, the radar data and the audio data to obtain radar-based location data and audio-based location data each corresponding to a location of at least one user; processing, by the software code executed by the processing hardware, the radar data and the audio data to obtain radar-based venue data and audio-based venue data each corresponding to an environment surrounding the at least one user; determining, by the software code executed by the processing hardware and using the radar-based location data and the audio-based location data, the location of the at least one user; determining, by the software code executed by the processing hardware and using the radar-based venue data and the audio-based venue data, the environment surrounding the at least one user; and identifying, by the software code executed by the processing hardware based on the location and the environment, an interactive expression for use by a social agent to interact with the at least one user.