- Number
- 12205211
- Published
- 2025-01-21
- Filed
- 2021-10-20
- Assignee
- Disney Enterprises, Inc.
- Inventors
- Brandon; Marc et al.
- CPC
- G10L21/055; H04N21/440236; H04N21/4316; H04N21/4394; G06V40/174; G06V20/40; G06F40/58; G06T11/00; G06T13/00; G06F3/1423; H04N21/4884; G06F40/216; G10L25/57; G06F40/30; G10L25/63; H04N21/43074; G06F40/169; G06F40/20; G10L15/22; G09B21/009; G06V20/41; H04N21/43079; H04N21/44008
- Verdict
- Set aside accessibility content-delivery feature, business (sign-language cluster, dup pattern)
- Source
- Google Patents · FreePatentsOnline
Abstract
A content enhancement system includes a computing platform having processing hardware and a system memory storing software code. The processing hardware is configured to execute the software code to receive audio-video (A/V) content, to execute at least one of a visual analysis or an audio analysis of the A/V content, and to determine, based on executing the at least one of the visual analysis or the audio analysis, an emotional aspect of the A/V content. The processing hardware is further configured to execute the software code to generate, using the emotional aspect of the A/V content, a sign language translation of the A/V content, the sign language translation including one or more of a gesture, a posture, or a facial expression conveying the emotional aspect.
Background
BACKGROUND (1) Members of the deaf and hearing impaired communities often rely on any of a number of signed languages for communication via hand signals. Although effective in translating the plain meaning of a communication, hand signals alone typically do not fully capture the emphasis or emotional intensity motivating that communication. Accordingly, skilled human sign language translators tend to employ multiple physical modes when communicating information. Those modes may include gestures other than hand signals, postures, and facial expressions, as well as the speed and force with which such expressive movements are executed. (2) For a human sign language translator, identification of the appropriate emotional intensity and emphasis to include in a signing performance may be largely intuitive, based on cognitive skills honed unconsciously as the understanding of spoken language is learned and refined through childhood and beyond. However, the exclusive reliance on human sign language translation can be expensive, and in some use cases may be inconvenient or even impracticable. Consequently, there is a need in the art for an automated solution for providing emotion-based sign language enhancement of content.
Claims
1. A content enhancement system comprising: a computing platform including a processing hardware and a system memory storing a character profile database and a software code, the character profile database including a first emotive profile associated with a first animated character for conveying an emotion using one or more of a first gesture, a first posture, or a first facial expression and a second emotive profile associated with a second animated character for conveying the emotion using one or more of a second gesture, a second posture, or a second facial expression different from the first gesture, the first posture, or the first facial expression, respectively; the processing hardware configured to execute the software code to: receive video content; execute a visual analysis of the video content; determine, based on executing the visual analysis of the video content, an emotional aspect of the video content being the emotion; identify one of the first animated character or the second animated character for performing the sign language enhancement; obtain, from the character profile database, one of the first emotive profile or the second emotive profile corresponding to the identified one of the first animated character or the second animated character; and generate, using the emotional aspect of the video content and the obtained one of the first emotive profile or the second emotive profile, a sign language enhancement conveying the emotion using one or more of the first gesture, the first posture, or the first facial expression or one or more of the second gesture, the second posture, or the second facial expression of the obtained one of the first emotive profile or the second emotive profile, respectively. ||
11. A method for use by a content enhancement system including a computing platform having a processing hardware and a system memory storing a character profile database and a software code, the character profile database including a first emotive profile associated with a first animated character for conveying an emotion using one or more of a first gesture, a first posture, or a first facial expression and a second emotive profile associated with a second animated character for conveying the emotion using one or more of a second gesture, a second posture, or a second facial expression different from the first gesture, the first posture, or the first facial expression, respectively, the method comprising: receiving, by the software code executed by the processing hardware, video content; executing, by the software code executed by the processing hardware, a visual analysis of the video content; determining, by the software code executed by the processing hardware, based on executing the visual analysis of the video content, an emotional aspect of the video content being the emotion; identifying, by the software code executed by the processing hardware, one of the first animated character or the second animated character for performing the sign language enhancement; obtaining, by the software code executed by the processing hardware, from the character profile database, one of the first emotive profile or the second emotive profile corresponding to the identified one of the first animated character or the second animated character; and generating, by the software code executed by the processing hardware, using the emotional aspect of the video content and the obtained one of the first emotive profile or the second emotive profile, a sign language enhancement conveying the emotion using one or more of the first gesture, the first posture, or the first facial expression or one or more of the second gesture, the second posture, or the second facial expression of the obtained one of the first emotive profile or the second emotive profile, respectively.