Outer Rim Archives
Archives · 2022 · 11269941

Granted patent

Automated storyboarding based on natural language processing and 2D/3D pre-visualization

Number
11269941
Published
2022-03-08
Filed
2018-10-09
Assignee
Disney Enterprises, Inc.
Inventors
Schriber; Sasha Anna, Sanghrajka; Rushit, Witon; Wojciech, Simo; Isabel, Kapadia; Mubbasir, Gross; Markus, Inversini; Daniel, Grosse; Max, Tsipidi; Eleftheria
CPC
G06N5/04; G06F3/0482; G06F16/383; G06F40/30; G06F16/34; G06F40/205; G06F3/0484; G06F3/167
Verdict
Set aside storyboard production tool, business
Source
Google Patents · FreePatentsOnline

Abstract

Systems and methods are provided for a workflow framework that scriptwriters can utilize when developing scripts. A script can be parsed to identify one or more elements in a script, and various visual representations of the one or more elements and/or a scene characterized in the script can be automatically generated. A user may develop or edit the script which can be presented in a visual and temporal manner. Information parsed from the script can be stored in basic information elements, and used to create a knowledge bases.

Background

TECHNICAL FIELD (1) The present disclosure relates generally to storyboard creation, and more particularly, to applying natural language processing (NLP) techniques to scripts in order to extract metadata upon which storyboards may be created. Moreover, the present disclosure relates to two-dimensional (2D)/three-dimensional (3D) pre-visualization of one or more aspects of a script. DESCRIPTION OF THE RELATED ART (2) A storyboard can refer to a sequence of images or drawings that describe technical and artistic parameters characterizing a form of media, such as a movie, a performance, and the like. Examples of these parameters can include a type of a shot, the position of a character, motion, camera, lighting, etc. that are used in creating a story on which the media is based. Traditional production teams follow a process whereby a script is developed or written. The script may then be translated into visual representations by storyboard artists. Storyboards can be useful for visualizing a story, the timing of each character's appearance, exit, action(s), etc., and a corresponding environment while still in the early stages of a media project, e.g., TV, live-action movie, animation, theatre, comics, novels, and other forms of media or performances. Storyboard creation is usually an iterative and lengthy process performed by a group of storyboard artists that sketch the visual representations by hand or with the help of digital sketching software. (3) Regarding the process of

Claims

1. A computer-implemented method, comprising: presenting a first visual representation of a script based on one or more elements of the script, wherein the first visual representation of the script is indicative of one or more words spoken or an action performed by a character in the script; receiving updated one or more words spoken or an updated action performed by the character in the script associated with an updated script; generating a second visual representation of the updated script, wherein the second visual representation is indicative of the updated one or more words spoken or the updated action performed, wherein the second visual representation comprises a timeline view associated with the character, and wherein a line that represents the character spans at least a portion of the timeline view to indicate a corresponding portion of time in a scene in which the character appears; and generating and updating, in real-time, a storyboard, based on the updated script, wherein the storyboard includes one or more frame objects of a camera shot selection from the updated script. || 14. A system, comprising: a memory storing one or more instructions; and a processor for executing the one or more instructions to: present a first visual representation of a script based on metadata extracted from the script, the metadata being representative of one or more elements of the script, wherein the first visual representation of the script is indicative of one or more words spoken or an action performed by a character in the script; receive updated one or more words spoken or an updated action performed by the character in the script associated with an updated script; generate a second visual representation of the updated script, wherein the second visual representation is indicative of the updated one or more words spoken or the updated action performed, wherein the second visual representation comprises a timeline view associated with the character, and wherein a line that represents the character spans at least a portion of the timeline view to indicate a corresponding portion of time in a scene in which the character appears; and generate and update, in real-time, a storyboard, based on the updated script, wherein the storyboard includes one or more frame objects of a camera shot selection from the updated script. || 20. A non-transitory computer readable medium storing instructions that, when executed by a processor, cause the processor to perform the steps of: presenting a first visual representation of a script based on one or more elements of the script, wherein the first visual representation of the script is indicative of one or more words spoken or an action performed by a character in the script; receiving updated one or more words spoken or an updated action performed by the character in the script associated with an updated script; generating a second visual representation of the updated script, wherein the second visual representation is indicative of the updated one or more words spoken or the updated action performed, wherein the second visual representation comprises a timeline view associated with the character, and wherein a line that represents the character spans at least a portion of the timeline view to indicate a corresponding portion of time in a scene in which the character appears; and generating and updating, in real-time, a storyboard, based on the updated script, wherein the storyboard includes one or more frame objects of a camera shot selection from the updated script.