Automated storyboarding based on natural language processing and 2D/3D pre-visualization

Number: 10977287
Published: 2021-04-13
Filed: 2018-10-09
Assignee: Disney Enterprises, Inc.
Inventors: Schriber; Sasha Anna, Simo; Isabel, Fung; Justine, Inversini; Daniel, Ferrari; Carolina, Grosse; Max, Gross; Markus
CPC: G06F16/34; G06F3/0484; G06N5/04; G06F40/205; G06F40/30; G06F16/383; G06F3/167; G06F3/0482
Verdict: Set aside storyboard authoring tool, business/production
Source: Google Patents · FreePatentsOnline

Abstract

Systems and methods are provided for a workflow framework that scriptwriters can utilize when developing scripts. A script can be parsed to identify one or more elements in a script, and various visual representations of the one or more elements and/or a scene characterized in the script can be automatically generated. A user may develop or edit the script which can be presented in a visual and temporal manner. Information parsed from the script can be stored in basic information elements, and used to create a knowledge bases.

Background

TECHNICAL FIELD (1) The present disclosure relates generally to storyboard creation, and more particularly, to applying natural language processing (NLP) techniques to scripts in order to extract metadata upon which storyboards may be created. Moreover, the present disclosure relates to two-dimensional (2D)/three-dimensional (3D) pre-visualization of one or more aspects of a script. DESCRIPTION OF THE RELATED ART (2) A storyboard can refer to a sequence of images or drawings that describe technical and artistic parameters characterizing a form of media, such as a movie, a performance, and the like. Examples of these parameters can include a type of a shot, the position of a character, motion, camera, lighting, etc. that are used in creating a story on which the media is based. Traditional production teams follow a process whereby a script is developed or written. The script may then be translated into visual representations by storyboard artists. Storyboards can be useful for visualizing a story, the timing of each character's appearance, exit, action(s), etc., and a corresponding environment while still in the early stages of a media project, e.g., TV, live-action movie, animation, theatre, comics, novels, and other forms of media or performances. Storyboard creation is usually an iterative and lengthy process performed by a group of storyboard artists that sketch the visual representations by hand or with the help of digital sketching software. (3) Regarding the process of

Claims

1. A computer-implemented method, comprising: determining one or more data elements of a script based on text in the script, wherein the one or more data elements include one or more of actions, interactions, or dialog in the script; determining one or more rule definitions associated with the script, wherein each rule definition specifies a rule for one or more characters or objects in the script; generating a knowledge base associated with the script and comprising information inferred from the one or more data elements and the one or more rule definitions; receiving one or more user queries regarding the script; and generating output corresponding to the one or more user queries based on the information in the knowledge base. || 15. A system, comprising: an analytics engine and a natural language processor configured to: determine one or more data elements of a script based on text in the script, wherein the one or more data elements include one or more of actions, interactions, or dialog in the script; determine one or more rule definitions associated with the script, wherein each rule definition specifies a rule for one or more characters or objects in the script; generate a knowledge base associated with the script and comprising information inferred from the one or more data elements and the one or more rule definitions; receive one or more user queries regarding the script; and generate output corresponding to the one or more user queries based on the information in the knowledge base.