ANIMATION MOTION CAPTURE USING THREE-DIMENSIONAL SCANNER DATA

Number: 20170046865
Published: 2017-02-16
Filed: 2015-08-14
Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
Inventors: Cantwell; Brian
CPC: H04N13/204; G06T7/75
Verdict: Low Notable software
Source: Google Patents · FreePatentsOnline

The keeper's note

Lucasfilm animation motion-capture technique using 3D scanner data.

Abstract

Systems and techniques are provided for performing animation motion capture of objects within an environment. For example, a method may include obtaining input data including a three-dimensional point cloud of the environment. The three-dimensional point cloud is generated using a three-dimensional laser scanner including multiple laser emitters and multiple laser receivers. The method may further include obtaining an animation model for an object within the environment. The animation model includes a mesh, an animation skeleton rig, and adjustable controls that control the animation skeletonrig to define a position of one or more faces of the mesh. The method may further includedetermining a pose of the object within the environment. Determining a pose includes fitting the one or more faces of the mesh to one or more points of a portion of the three-dimensional point cloud. The portion of the three-dimensional point cloud corresponds to the object in the environment. The fitting includes reducing errors between the one or more faces and the one or more corresponding points using the adjustable controls.

Background

BRIEF DESCRIPTION OF DRAWINGS

Illustrative embodiments of the present invention are described in detail below with reference to the following drawing figures:

FIG. 1 illustrates an example of an environment comprising a system for performing motion capture.

FIG. 2 illustrates an example of a three-dimensional laser scanner.

FIG. 3 illustrates an example of a system for performing motion capture of objects within an environment.

FIG. 4 illustrates an example of a fitting process.

FIG. 5 is a flow chart illustrating a process for performing animation motion capture of objects within an environment.

FIG. 6 shows an example of a computer system that maybe used in various embodiments of the present invention.DETAILED DESCRIPTION

In thefollowing description, for the purposes of explanation, specific details are set forth inorder to provide a thorough understanding of embodiments of the invention. However, it will be apparent that various embodiments may be practiced without these specific details. The figures and description are not intended to be restrictive.

The ensuing description provides exemplary embodiments only, and is not intended to limit the scope, applicability, or configuration of the disclosure. Rather, the ensuing description of the exemplary embodiments will provide those skilled in the art with an enabling description for implementing an exemplary embodiment. It should be understood that various changes may b

Claims

1. Acomputer-implemented method of performing animation motion capture of objects within an environment, comprising: obtaining input data including a three-dimensional point cloud of the environment, the three-dimensional point cloud being generated using a three-dimensional laser scanner including multiple laser emitters and multiple laser receivers; obtainingan animation model for an object within the environment, the animation model including a mesh, an animation skeleton rig, and adjustable controls that control the animation skeleton rig to define a position of one or more faces of the mesh; and determining a pose of the object within the environment, including fitting the one or more faces of the mesh to one or more points of a portion of the three-dimensional point cloud, the portion of the three-dimensional point cloud corresponding to the object in the environment, wherein fittingincludes reducing errors between the one or more faces and the one or more corresponding points using the adjustable controls. 8. A system for performing animation motion capture of objects within an environment, comprising: a memory storing a plurality of instructions; and one or more processors configurable to: obtain input data including a three-dimensional point cloud of the environment, the three-dimensional point cloud being generated using a three-dimensional laser scanner including multiple laser emitters and multiple laser receivers; obtain an animation model for an object within the environment, the animation model including a mesh, an animation skeleton rig, and adjustable controls that control the animation skeleton rig to define a position of one or more faces of the mesh; and determine a pose of the object within the environment, including fitting the one or more faces of the mesh to one or more points of a portion of the three-dimensional point cloud, the portion of the three-dimensional point cloud corresponding to the object in the environment, wherein fitting includes reducing errors between the one or more faces and the one or more corresponding points using the adjustable controls. 15. A computer-readable memory storinga plurality of instructions executable by one or more processors, the plurality of instructions comprising: instructions that cause the one or more processors to obtain input dataincluding a three-dimensional point cloud of an environment, the three-dimensional point cloud being generated using a three-dimensional laser scanner including multiple laser emitters and multiple laser receivers; instructions that cause the one or more processors to obtain an animation model for an object within the environment, the animation model including a mesh, an animation skeleton rig, and adjustable controls that control the animation skeleton rig to define a position of one or more faces of the mesh; and instructions that cause the one or more processors to determine a pose of the object within the environment,including fitting the one or more faces of the mesh to one or more points of a portion ofthe three-dimensional point cloud, the portion of the three-dimensional point cloud corresponding to the object in the environment, wherein fitting includes reducing errors between the one or more faces and the one or more corresponding points using the adjustable controls.