AUTOMATED STORYBOARDING BASED ON NATURAL LANGUAGE PROCESSING AND 2D/3D PRE-VISUALIZATION

Number: 20190107927
Published: 2019-04-11
Filed: 2018-10-09
Assignee: Disney Enterprises, Inc.
Inventors: Schriber; Sasha Anna, Sanghrajka; Rushit, Witon; Wojciech, Simo; Isabel, Kapadia; Mubbasir, Gross; Markus, Inversini; Daniel, Grosse; Max, Tsipidi; Eleftheria
CPC: G06F40/30; G06F3/167; G06F3/0482; G06F3/0484; G06F16/34; G06N5/04; G06F40/205; G06F16/383
Verdict: Low Notable software
Source: Google Patents · FreePatentsOnline

The keeper's note

Automated storyboarding NLP+2D/3D pre-visualization.

Abstract

Systems and methods are provided for a workflow framework that scriptwriters can utilize when developing scripts. A script can be parsed to identify one or more elements in a script, and various visual representations of the one or more elements and/or a scene characterized in the script can be automatically generated. A user may develop or edit the script which can be presented in a visual and temporal manner. Information parsed from the script can be stored in basic information elements, and used to create a knowledge bases.

Background

TECHNICAL FIELD

The present disclosure relates generally to storyboard creation, and more particularly, to applying natural language processing (NLP) techniques to scripts in order to extract metadata upon which storyboards may be created. Moreover, the present disclosure relates to two-dimensional (2D)/three-dimensional (3D) pre-visualization of one or more aspects of a script.DESCRIPTION OF THE RELATED ART

A storyboard can refer to a sequence of images or drawings that describe technical and artistic parameters characterizing a form of media, such as a movie, a performance, and the like. Examples of these parameters can include a type of a shot, the position of a character, motion, camera, lighting, etc. that are used in creating a story on which the media is based. Traditional production teams follow a process whereby a script is developed or written. The script may then be translated into visual representations by storyboard artists. Storyboards can be useful for visualizing a story, the timing of each character's appearance, exit, action(s), etc., and a corresponding environment while still in the early stages of a media project, e.g., TV, live-action movie, animation, theatre, comics, novels, and other forms of media or performances. Storyboard creation is usually an iterative and lengthy process performed by a group of storyboard artists that sketch the visual representations by hand or with the help of digital sketching software.

Regarding the proces

Claims

1. A computer-implemented method, comprising: presenting a visual representation of the script based on one or more elements of a script; presenting a visual representation of an updated script based on one or more updates to the one or more elements of the script; generating a visual representation of one or more characters' evolution in the script or updated script; generating and updating, in real-time, a storyboard, based on the script or updated script, respectively, the storyboard including the visual representation of the one or more characters' evolution; and generating at least one of a two-dimensional (2D), three-dimensional (3D), and camera-view preview of the script or updated script. 15. A system, comprising: at least one of natural language processor and an analytics engine extracting metadata from a script or an updated script; and a visualization engine: presenting a visual representation of the script based on the metadata, the metadata being representative of one or more elements of a script; presenting a visual representation of an updated script based on one or more updates to the one or more elements of the script; generating a visual representation of one or more characters' evolution in the script or updated script; generating and updating, in real-time, a storyboard, based on the script or updated script, respectively, the storyboard including the visual representation of the one or more characters' evolution; and generating at least one of a two-dimensional (2D), three-dimensional (3D), and camera-view preview of the script or updated script.