Multi-Level Emotional Enhancement of Dialogue

Number: 20240070399
Published: 2024-02-29
Filed: 2022-08-24
Assignee: Disney Enterprises, Inc.
Inventors: Tiwari; Sanchita et al.
CPC: G10L13/10; G06F40/284; G10L25/63; G06F40/289; G06F40/216; G10L13/08; G06N20/00; G06F40/35; G06F40/30
Verdict: Low Notable software
Source: Google Patents · FreePatentsOnline

The keeper's note

Emotionally enhanced dialogue technique for interactive characters.

Abstract

A system for emotionally enhancing dialogue includes a computing platform having processing hardware and a system memory storing a software code including a predictive model. The processing hardware is configured to execute the software code to receive dialogue data identifying an utterance for use by a digital character in a conversation, analyze, using the dialogue data, an emotionality of the utterance at multiple structural levels of the utterance, and supplement the utterance with one or more emotional attributions, using the predictive model and the emotionality of the utterance at the multiple structural levels, to provide one or more candidate emotionally enhanced utterance(s). The processing hardware further executes the software code to perform an audio validation of the candidate emotionally enhanced utterance(s) to provide a validated emotionally enhanced utterance, and output an emotionally attributed dialogue data providing the validated emotionally enhanced utterance for use by the digital character in the conversation.

Background

BACKGROUND

Advances in artificial intelligence (AI) have led to the generation of a variety of digital characters, such as avatars for example, that simulate social interaction. However, conventionally generated AI digital characters typically project a single synthesized persona that tends to lack a distinctive personality and is unable to credibly express emotions.

In contrast to conventional interaction simulations by AI digital characters, natural interactions between human beings are more nuanced, varied, and dynamic. For example, conversations between humans are typically expressive of the emotional states of the dialogue partners. That is to say, typical shortcomings of AI digital character interactions include their failure to inflect the words they utter with emotional states such as excitement, disappointment, anxiety, and optimism, to name a few. Thus, there is a need in the art for a dialogue enhancement solution capable of producing emotionally expressive utterances for execution in real-time during a dialogue between a digital character and a dialogue partner such as a human user.

Claims

1. A system comprising: a computing platform having a processing hardware and a system memory storing a software code, the software code including a predictive model; the processing hardware configured to execute the software code to: receive dialogue data identifying an utterance for use by a digital character in a conversation; analyze, using the dialogue data, an emotionality of the utterance at a plurality of structural levels of the utterance; supplement the utterance with one or more emotional attributions, using the predictive model and the emotionality of the utterance at the plurality of structural levels, to provide one or more candidate emotionally enhanced utterances; perform an audio validation of the one or more candidate emotionally enhanced utterances to provide a validated emotionally enhanced utterance; and output an emotionally attributed dialogue data providing the validated emotionally enhanced utterance for use by the digital character in the conversation. || 12. A method for use by a system including a computing platform having a processing hardware and a system memory storing a software code, the software code including a predictive model: receiving, by the software code executed by the processing hardware, dialogue data identifying an utterance for use by a digital character in a conversation; analyzing, by the software code executed by the processing hardware and using the dialogue data, an emotionality of the utterance at a plurality of structural levels of the utterance; supplementing the utterance with one or more emotional attributions, by the software code executed by the processing hardware and using the predictive model and the emotionality of the utterance at the plurality of structural levels, to provide one or more candidate emotionally enhanced utterances; performing, by the software code executed by the processing hardware, an audio validation of the one or more candidate emotionally enhanced utterances to provide a validated emotionally enhanced utterance; and outputting, by the software code executed by the processing hardware, an emotionally attributed dialogue data providing the validated emotionally enhanced utterance for use by the digital character in the conversation.