- Number
- 11645813
- Published
- 2023-05-09
- Filed
- 2020-07-06
- Assignee
- DISNEY ENTERPRISES, INC.
- Inventors
- Gruber; Aurel et al.
- CPC
- G06T17/20; G06T7/60
- Verdict
- Low Notable software
- Source
- Google Patents · FreePatentsOnline
The keeper's note
Anatomically-based digital-face sculpting technique (granted).
Abstract
Techniques are disclosed for creating digital faces. In some examples, an anatomical face model is generated from a data set including captured facial geometries of different individuals and associated bone geometries. A model generator segments each of the captured facial geometries into patches, compresses the segmented geometry associated with each patch to determine local deformation subspaces of the anatomical face model, and determines corresponding compressed anatomical subspaces of the anatomical face model. A sculpting application determines, based on sculpting input from a user, constraints for an optimization to determine parameter values associated with the anatomical face model. The parameter values can be used, along with the anatomical face model, to generate facial geometry that reflects the sculpting input.
Background
BACKGROUND Technical Field (1) Embodiments of the present disclosure relate generally to computer science and computer graphics and, more specifically, to techniques for sculpting digital faces based on anatomical modeling. Description of the Related Art (2) Realistic digital faces are required for various computer graphics and computer vision applications. For example, digital faces oftentimes are used in the virtual scenes of film productions and in video games. (3) Digital faces can be created using free-form sculpting tools. Commercially-available sculpting tools, such as ZBrush®, Mudbox®, and Maya®, permit significant artistic freedom in sculpting digital faces by hand. However, manual sculpting of digital faces requires a user to be skilled at free-form sculpting and is oftentimes labor intensive. Using a conventional sculpting tool, a skilled user can spend weeks, or even months, creating a single digital face. (4) One approach that allows users who are not skilled at free-form sculpting to create digital faces involves generating the digital faces using predetermined libraries of exemplar faces (e.g., blendshape models), from which the users can select and blend different three-dimensional (3D) geometries together, in order to create new faces. However, such an approach limits the digital faces that can be created to the exemplar faces and blendings of those faces. As a result, users may not be able to create digital faces with desired characteristics. (5) As the fore
Claims
1. A computer-implemented method for generating a digital face, the method comprising: segmenting a plurality of facial geometries associated with a plurality of different individuals into a first plurality of patch geometries corresponding to a plurality of patches of skin; generating, based on the segmented plurality of facial geometries, a plurality of local deformation subspaces defining how the plurality of patches deform, wherein each local deformation subspace included in the plurality of local deformation subspaces is generated based on an aggregation of a second plurality of patch geometries corresponding to a subset of the first plurality of patch geometries for a patch included in the plurality of patches; generating, based on a plurality of bone geometries associated with the plurality of different individuals, a plurality of anatomical subspaces defining at least one of how the plurality of patches slide on underlying bones, in which directions the plurality of patches slide, or skin thicknesses associated with the plurality of patches, wherein each anatomical subspace included in the plurality of anatomical subspaces is generated based on an aggregation of a portion of the plurality of bone geometries associated with a patch included in the plurality of patches; performing one or more optimization operations based on (i) a model that includes the plurality of local deformation subspaces and the plurality of anatomical subspaces and (ii) one or more constraints to determine parameter values associated with the model; and generating a three-dimensional (3D) facial geometry based on the parameter values and the model. ||
11. One or more non-transitory computer-readable storage media including instructions that, when executed by one or more processing units, cause the one or more processing units to generate a digital face, by performing the steps of: segmenting a plurality of facial geometries associated with a plurality of different individuals into a first plurality of patch geometries corresponding to a plurality of patches of skin; generating, based on the segmented plurality of facial geometries, a plurality of local deformation subspaces defining how the plurality of patches deform, wherein each local deformation subspace included in the plurality of local deformation subspaces is generated based on an aggregation of a second plurality of patch geometries corresponding to a subset of the first plurality of patch geometries for a patch included in the plurality of patches; generating, based on a plurality of bone geometries associated with the plurality of different individuals, a plurality of anatomical subspaces defining at least one of how the plurality of patches slide on underlying bones, in which directions the plurality of patches slide, or skin thicknesses associated with the plurality of patches, wherein each anatomical subspace included in the plurality of anatomical subspaces is generated based on an aggregation of a portion of the plurality of bone geometries associated with a patch included in the plurality of patches; performing one or more optimization operations based on (i) a model that includes the plurality of local deformation subspaces and the plurality of anatomical subspaces and (ii) one or more constraints to determine parameter values associated with the model; and generating a three-dimensional (3D) facial geometry based on the parameter values and the model. ||
19. A system, comprising: one or more memories that include instructions; and one or more processors that are coupled to the one or more memories and, when executing the instructions: segment a plurality of facial geometries associated with a plurality of different individuals into a first plurality of patch geometries corresponding to a plurality of patches of skin, generate, based on the segmented plurality of facial geometries, a plurality of local deformation subspaces defining how the plurality of patches deform, wherein each local deformation subspace included in the plurality of local deformation subspaces is generated based on an aggregation of a second plurality of patch geometries corresponding to a subset of the first plurality of patch geometries for a patch included in the plurality of patches, generate, based on a plurality of bone geometries associated with the plurality of different individuals, a plurality of anatomical subspaces defining at least one of how the plurality of patches slide on underlying bones, in which directions the plurality of patches slide, or skin thicknesses associated with the plurality of patches, wherein each anatomical subspace included in the plurality of anatomical subspaces is generated based on an aggregation of a portion of the plurality of bone geometries associated with a patch included in the plurality of patches, perform one or more optimization operations based on (i) a model that includes the plurality of local deformation subspaces and the plurality of anatomical subspaces and (ii) one or more constraints to determine parameter values associated with the model, and generate a three-dimensional (3D ) facial geometry based on the parameter values and the model.