- Number
- 20190019342
- Published
- 2019-01-17
- Filed
- 2018-09-17
- Assignee
- Disney Enterprises, Inc.
- Inventors
- Sumner; Robert, Ngo; Dat Tien, Nitti; Maurizio, Marra; Alessia, Magnenat; Stephane, Ryffel; Mattia
- CPC
- G06T7/10; G06T7/149; G06T19/006; G06V20/647; G06T7/11
- Verdict
- Medium Notable software
- Source
- Google Patents · FreePatentsOnline
The keeper's note
Deformable-surface tracking based AR image generation PGPUB dup.
Abstract
There are provided systems and methods for performing deformable-surface tracking based augmented reality image generation. In one implementation, such a system includes a hardware processor and a system memory storing an augmented reality three-dimensional image generator. The hardware processor is configured to execute the augmented reality three-dimensional image generator to receive image data corresponding to a two-dimensional surface, and to identify an image template corresponding to the two-dimensional surface based on the image data. In addition, the hardware processor is configured to execute the augmented reality three-dimensional image generator to determine a surface deformation of the two-dimensional surface. The hardware processor is further configured to execute the augmented reality three-dimensional image generator to generate an augmented reality three-dimensional image including at least one feature of the two-dimensional surface, based on the image template and the surface deformation of the two-dimensional surface.
Background
BACKGROUND
The visual richness and immersiveness provided by modern information and entertainment technologies have increasingly led users to abandon more traditional, tangible media, especially print media such as books, in favor of electronic media content. Nevertheless, some forms of tangible media have resisted translation into electronic form due to the physically interactive way that users of such tangible media typically engage with them. For example, an artist's tactile experience while marking a canvas, or that of a child marking a coloring book may not be easily replicated through use of a conventional electronic user interface. Thus, a real-time solution enabling generation of augmented reality images from tangible images produced or modified by hand is desirable in order to more fully extend the visual richness and immersiveness enabled by use of electronic media to the creative activities of artists and children.SUMMARY
There are provided systems and methods for deformable-surface tracking based augmented reality image generation, substantially as shown in and/or described in connection with at least one of the figures, and as set forth more completely in the claims.
Claims
21. A system comprising: a hardware processor; a system memory having an augmented reality three-dimensional image generator stored therein; wherein the hardware processor is configured to execute the augmented reality three-dimensional image generator to: receive image data corresponding to a two-dimensional surface; identify an image template corresponding to the two-dimensional surface based on the image data; determine a surface deformation of the two-dimensional surface, wherein determining the surface deformation includes representing the two-dimensional surface by a two-dimensional mesh, regularizing the two-dimensional mesh, and performing an outlier rejection using a linear subspace parameterization and based on the regularized two-dimensional mesh; after performing the outlier rejection using the linear subspace parameterization, apply a three-dimensional optimization to the surface deformation of the two-dimensional surface; and generate an augmented reality three-dimensional image using the three-dimensional optimized surface deformation of the two-dimensional surface.
28. A method for use by a system including a hardware processor and an augmented reality three-dimensional image generator stored in a system memory, the method comprising: receiving, using the hardware processor, image data corresponding to a two-dimensional surface; identifying, using the hardware processor, an image template corresponding to the two-dimensional surface based on the image data; determining, using the hardware processor, a surface deformation of the two-dimensional surface, wherein determining the surface deformation includes representing the two-dimensional surface by a two-dimensional mesh, regularizing the two-dimensional mesh, and performing an outlier rejection using a linear subspace parameterization and based on the regularized two-dimensional mesh; after performing the outlier rejection using the linear subspace parameterization, applying, using the hardware processor, a three-dimensional optimization to the surface deformation of the two-dimensional surface; and generating, using the hardware processor, an augmented reality three-dimensional image using the three-dimensional optimized surface deformation of the two-dimensional surface.
35. A computer-readable non-transitory medium having stored thereon instructions, which when executed by a hardware processor, instantiate a method comprising: receiving image data corresponding to a two-dimensional surface; identifying an image template corresponding to the two-dimensional surface based on the image data; determining a surface deformation of the two-dimensional surface, wherein determining the surface deformation includes representing the two-dimensional surface by a two-dimensional mesh, regularizing the two-dimensional mesh, and performing an outlier rejection using a linear subspace parameterization and based on the regularized two-dimensional mesh; after performing the outlier rejection using the linear subspace parameterization, applying a three-dimensional optimization to the surface deformation of the two-dimensional surface; and generating an augmented reality three-dimensional image using the three-dimensional optimized surface deformation of the two-dimensional surface.