Deformable-Surface Tracking Based Augmented Reality Image Generation

Number: 20170053442
Published: 2017-02-23
Filed: 2015-08-20
Assignee: DISNEY ENTERPRISES, INC.
Inventors: Sumner; Robert et al.
CPC: G06T19/006; G06T7/149; G06V20/647
Verdict: Medium Notable software
Source: Google Patents · FreePatentsOnline

The keeper's note

AR image generation using deformable-surface tracking — computer-vision/AR technique.

Abstract

Thereare provided systems and methods for performing deformable-surface tracking based augmented reality image generation. In one implementation, such a system includes a hardware processor and a system memory storing an augmented reality three-dimensional image generator. The hardware processor is configured to execute the augmented reality three-dimensional image generator to receive image data corresponding to a two-dimensional surface, and to identify an image template corresponding to the two-dimensional surface based on the image data. In addition, the hardware processor is configured to execute the augmented reality three-dimensional image generator to determine a surface deformation of the two-dimensional surface. The hardware processor is further configured to execute the augmented reality three-dimensional image generator to generate an augmented reality three-dimensional image including at least one feature of the two-dimensional surface, based on the image template and the surface deformation of the two-dimensional surface.

Background

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a diagram of an exemplary system configured to perform deformable-surface tracking based augmented reality image generation, according to one implementation;

FIG. 2 shows another exemplary implementation of a system configured to perform deformable-surface tracking based augmented reality image generation;

FIG. 3 shows an exemplary system and a computer-readable non-transitory medium including instructions enabling deformable-surface tracking based augmented reality image generation, according to one implementation;

FIG. 4 is a flowchart presenting an exemplary method for use by a system to perform deformable-surface tracking based augmented reality image generation;

FIG. 5A shows an exemplary deformable-surface depicted as a page in a coloring book including a user modified feature, according to one implementation; and

FIG. 5B shows an exemplary augmented reality three-dimensional image generated based on the deformable-surface shown in FIG. 5A.DETAILED DESCRIPTION

The following description contains specific information pertaining to implementations in the present disclosure. One skilled in the art will recognize that the present disclosure may be implemented in a manner different from that specifically discussed herein. The drawings in the present application and their accompanying detailed description are directed to merely exemplary implementations. Unless noted otherwise, like or cor

Claims

1. A system comprising: a hardware processor; a system memory having an augmented reality three-dimensional image generator stored therein; wherein the hardware processor is configured to execute the augmented reality three-dimensional image generator to: receive image data corresponding toa two-dimensional surface; identify an image template corresponding to the two-dimensional surface based on the image data; determine a surface deformation of the two-dimensional surface, wherein determining the surface deformation includes representing the two-dimensional surface by a two-dimensional mesh, regularizing the two-dimensional mesh, and performing an outlier rejection based on the regularized two-dimensional mesh; and generate an augmented reality three-dimensional image including at least one feature of the two-dimensional surface based on the image template and the surface deformation of the two-dimensionalsurface. 8. A method for use by a system including a hardware processor and an augmented reality three-dimensional image generator stored in a system memory, the method comprising: receiving, using the hardware processor, image data corresponding to a two-dimensional surface; identifying, using the hardware processor, an image template corresponding to the two-dimensional surface based on the image data; determining, using the hardware processor, a surface deformation of the two dimensional surface, wherein the determining includes representing the two-dimensional surface by a two-dimensional mesh, regularizing the two-dimensional mesh, and performing an outlier rejection based on the regularized two-dimensional mesh; and generating, using the hardware processor, an augmented reality three-dimensional image including at least one feature of the two-dimensional surface based on the imagetemplate and the surface deformation of the two-dimensional surface. 15. A computer-readable non-transitory medium having stored thereon instructions, which when executed by a hardware processor, instantiate a method comprising: receiving image data corresponding to a two-dimensional surface; identifying an image template corresponding to the two-dimensional surface based on the image data; determining a surface deformation of the two dimensional surface, wherein the determining includes representing the two-dimensional surface by a two-dimensional mesh, regularizing the two-dimensional mesh, and performing an outlier rejection based on the regularized two-dimensional mesh; and generating an augmented reality three-dimensional image including at least one feature of the two-dimensional surface based on the image template and the surface deformation of the two-dimensional surface.