Capturing and stylizing hair for 3D fabrication

Number: 9710965
Published: 2017-07-18
Filed: 2014-09-10
Assignee: Disney Enterprises, Inc.
Inventors: Beeler; Thabo, Bradley; Derek, Echevarria; Jose Ignacio
CPC: G06T19/20; G06T17/20; G06T15/205
Verdict: Low Notable software
Source: Google Patents · FreePatentsOnline

The keeper's note

Captures and stylizes a real hairstyles color and shape from multi-angle images for use in 3D character fabrication or animation.

Abstract

A process, computer program product, and apparatus provide color and shape stylization for a captured hairstyle. The process, computer program product, and apparatus receive a plurality of images of a hairstyle in an n dimensional space at a plurality of different angles. Further, the process, computer program product, and apparatus generate a mesh surface in an n−1 dimensional space. In addition, the process, computer program product, and apparatus combine color data from the plurality of images at the plurality of different angles with mesh geometry data of the meshsurface. The process, computer program product, and apparatus also stylize the color datawith an n dimensional filter that projects the color data to the n−1 dimensional space ofthe mesh surface. The process, computer program product, and apparatus may also stylize the geometric shape details in a coherent manner with the color.

Background

BRIEF DESCRIPTION OF THE DRAWINGS(1) The patent or application file contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawing(s) will be provided by the Office upon request and payment of the necessary fee.(2) The above-mentioned features of the present disclosure will become more apparent with reference to the following description taken in conjunction with the accompanying drawings wherein like reference numerals denote like elements and in which:(3) FIG. 1 illustrates an exemplary stylized hair capture process used.(4) FIG. 2 illustrates a multi-view stylized hair capture configuration.(5) FIG. 3 illustrates an example of the plurality of images illustrated in FIG. 1 captured from four different orientations defined by ninety degree rotations.(6) FIG. 4 illustrates the computed partial reconstructions.(7) FIG. 5 illustrates an example of the mesh surface that is generated from the computed partial reconstructions illustrated in FIG. 4.(8) FIG. 6 illustrates amapping configuration that performs the calculations for computing and retrieving the color information from the mesh surface.(9) FIG. 7 illustrates a recursive mapping configuration that is performs the calculations for computing and retrieving the color information from the mesh surface in such an instance.(10) FIG. 8 illustrates a process that is provides color stylization for a hair style.(11) FIG. 9 illustrates a process that performs geometry styl

Claims

1. A method comprising: receiving a plurality of images of a hairstyle at a plurality of different angles; combining color data from the plurality of images at the plurality of different angles with mesh geometry data from a mesh surface of the hairstyle; reducing a complexity of the hairstyle by stylizing the color data of the mesh surface to retain one or more directional wisps of the hairstyle; computing spatially varying surface offsets; displacing the vertices of the geometry of the mesh surface in a normal direction by an amount equaling the offsets multiplied by the normal direction; converting high frequency stylized intensity offsets to the spatially varying offsets; and combining the high frequency color and the lowcolor frequency color information to stylize the mesh surface with color and geometry. 11. A computer program product comprising a computer readable storage device having a computer readable program stored thereon, wherein the computer readable program while executing on a computer causes the computer to: receive a plurality of images of a hairstyle at a plurality of different angles; combine color data from the plurality of images at the plurality of different angles with mesh geometry data from a mesh surface of the hairstyle; reduce a complexity of the hairstyle by stylizing the color data of the mesh surface to retainone or more directional wisps of the hairstyle; compute spatially varying offsets; displace the vertices of the geometry of the mesh surface in a normal direction by an amount equaling the offsets multiplied by the normal direction; convert high frequency stylized intensity offsets to the spatially varying offsets; and combine the high frequency color and the low color frequency color information to stylize the mesh surface with color and geometry. 21. An apparatus comprising: a processor that receives a plurality of images of a hairstyle at a plurality of different angles, combines color data from the plurality of imagesat the plurality of different angles with mesh geometry data from a mesh surface of the hairstyle, reduces a complexity of the hairstyle by stylizing the color data of the mesh surface to retain one or more directional wisps of the hairstyle, computes spatially varyingoffsets, displaces the vertices of the geometry of the mesh surface in a normal directionby an amount equaling the offsets multiplied by the normal direction, converts high frequency stylized intensity offsets to the spatially varying offsets, and combines the high frequency color and the low color frequency color information to stylize the mesh surface with color and geometry.