Outer Rim Archives
Archives · 2020 · 10546431

Granted patent

Systems and methods to augment an appearance of physical object for an augmented reality experience

Number
10546431
Published
2020-01-28
Filed
2018-03-29
Assignee
Disney Enterprises, Inc.
Inventors
Hsu; Jonathan R.
CPC
G06F3/011; G06T19/006; G06F3/03; G06F3/0346
Verdict
Low Hardware
Source
Google Patents · FreePatentsOnline

The keeper's note

AR augmentation of a physical object's appearance.

Abstract

This disclosure relates to augmenting a physical object with overlay images. An overlay image may be selected to augment the appearance of the physical object. The overlay image may be selected from a repository based on the movement of the physical object. The overlay image may be selected based on whether the physical object is projected. Responsive to determining that the physical object is projected, a first overlay image is selected. The selected first overlay image may be presented over views of the physical object. Responsive to determining the physical object is being held by a user, a second overlay image is selected. The selected second overlay image may be presented over views of the physical object. The appearance of the physical object in a client computing device may be augmented by the selected overlay image.

Background

FIELD OF THE DISCLOSURE(1) The present disclosure relates to augmenting an appearance of a physical object in an augmented reality experience.BACKGROUND(2) Virtual content may be presented to augment an appearance of an object in an augmented reality experience.SUMMARY(3) One aspect of this disclosure relates to augmenting an appearance of a physical object with overlay images. The physical object may be augmented within an augmented reality experience. The augmented reality experience may include views of virtual content (e.g., formed by the overlay images) superimposed over views of a real-world environment. The overlay images may include virtual content, and/or other information. The virtual content may include static and/or dynamic content. Static virtual content may refer to static images. Dynamic content may refer to moving images, including video.(4) An overlay image selected to augment the appearance of the physical object may be based on a movement of the physical object. For example, the overlay image may be selected based on whether the physical object is projected, held by a user, stationary, and/or in other states. A projection of the physical object may require the physical object to leave contact with the user. The physical object may be projected when it is propelled, discharged, launched, thrown, rolled, tossed, sent in-flight, airborne, dropped, and/or otherwise projected from the user. The physical object may be projected by a user and/or a device operated

Claims

1. A system configured to augment an appearance of an object, the system comprising: a display device configured to effectuate presentation of an overlay image, the overlay image depicting virtual content, the display device being configured such that the overlay image is presented over views of a real-world environment such that the virtual content is perceived as being present in the real-world environment; an image sensor configured to generate output signals conveying visual information within a field of view of the image sensor, the visual information defining visual content including depictions of real-world surfaces and/or objects present in the real-world environment within the field of view; and one or more processors configured by machine-readable instructions to: detect, based on the output signals conveying the visual information, presence of a physical object in the real-world environment, the physical object comprising a handheld object, the physical object carrying a patterned light source; determine, based on the output signals conveying the visual information, location of the physical object over time; determine, based on the location, whether the physical object is projected within the real-world environment; select, based on whether the physical object is projected within the real-world environment, the overlay image to augment an appearance of the physical object, such that responsive to determining the physical object is projected at a first point in time, a first overlay image is selected to augment the appearance of the physical object at the first point in time, and responsive to determining the physical object is not projected at a second point in time, a second overlay image is selected to augment the appearance of the physical object at the second point in time; effectuate presentation of the selected overlay image on the display device so that the selected overlay image is perceived to augment the appearance of the physical object, such that the first overlay image is presented at the first point in time and the second overlay image is presented at the second point in time. 12. A method for to augment an appearance of an object, the method comprising: detecting, based on output signals conveying visual information generated by an image sensor, presence of a physical object in the real-world environment, the physical object comprising a handheld object, the physical object carrying a patterned light source; determining, based on the output signals conveying the visual information, location of the physical object over time; determining, based on the location, whether the physical object is projected within the real-world environment; selecting, based on whether the physical object is projected within the real-world environment, the overlay image to augment an appearance of the physical object, such that responsive to determining the physical object is projected at a first point in time, a first overlay image is selected to augment the appearance of the physical object at the first point in time, and responsive to determining the physical object is not projected at a second point in time, a second overlay image is selected to augment the appearance of the physical object at the second point in time; effectuating presentation of the selected overlay image on a display device so that the selected overlay image is perceived to augment the appearance of the physical object, including effectuating presentation of the first overlay image at the first point in time and the second overlay image at the second point in time.