- Number
- 11663783
- Published
- 2023-05-30
- Filed
- 2017-02-10
- Assignee
- Disney Enterprises, Inc.
- Inventors
- Goslin; Michael P. et al.
- CPC
- G06F3/011; G06F3/013; G06T19/006
- Verdict
- Low Notable software
- Source
- Google Patents · FreePatentsOnline
The keeper's note
AR technique integrated with IoT devices.
Abstract
This disclosure relates to systems and methods for using augmented reality with the internet of things. An augmented reality experience may be provided based on an operation of an object. Operation status information of a detected object may be obtained and a visual effect may be determined based on the operation status information. An object may be controlled using augmented reality. Operation status information of a detected object may be obtained and a control option may be determined based on the operation status information. A visual effect may be determined based on the control option and a user input regarding the control option may be obtained. A control information configured to effectuate a change in the operation of the object may be transmitted to the object.
Background
FIELD (1) This disclosure relates to systems and methods for providing augmented reality experience based on an operation of an object. BACKGROUND (2) Internet of Things (IoT) devices may include devices that use the Internet (or other communication networks) to send and/or receive information to/from a remote device. IoT devices may send information relating to their operation over a communication network so that a remote device may observe the operation of the IoT devices. IoT devices may receive information relating to their operation over a communication network so that a remote device may control the operation of the IoT devices. (3) To check the operation of an object (e.g., toy, appliance, etc.), a user may need to look at a display on the object and/or use a controller for the object. Checking the operation of an object in such a manner may be inconvenient and time consuming. SUMMARY (4) This disclosure relates to augmenting an appearance of an object. To provide an augmented reality experience based on an operation of an object, an object may be detected and a position and/or an orientation of the object may be determined. Operation status information may be obtained and a visual effect may be determined based on the operation status information. An overlay position and/or an overlay orientation for the visual effect may be determined and an overlay image including the visual effect may be determined. The overlay image may be displayed. (5) A system that tracks objec
Claims
1. A system to control operation of an object through an augmented reality experience, the system comprising: an augmented reality display; an image sensor configured to generate output signals conveying visual information within a field of view of the image sensor; and one or more processors are configured by machine-readable instructions to: detect, based on the output signals, an object present within a real-world environment; establish wireless communication between the one or more processors and the object; obtain, from the object via the wireless communication, operation status information characterizing status of a current operation of the object; determine a control option for the object based on the operation status information, wherein the control option is associated with effectuating a change in the current operation of the object conveyed by the operation status information; generate an overlay image comprising a visual effect, the visual effect indicating the control option; effectuate displaying of the overlay image including the visual effect on the augmented reality display; detect, based on the output signals, a landmark within the field of view of the image sensor; determine, based on detection of the landmark within the field of view of the image sensor, that a user is performing an action of directing the field of view of the image sensor to the landmark; detect, based on performance of the action of directing the field of view of the image sensor to the landmark and the landmark being related to the control option, user input by the user conveying selection of the control option; responsive to detecting the user input, generate control information including instructions to effectuate the change in the current operation of the object; and effectuate transmission, from the one or more processors to the object via the wireless communication, of the control information so that the object effectuates the change in the current operation of the object. ||
9. A method to control operation of an object through an augmented reality experience, the method comprising: generating an output signal conveying visual information within a field of view of an image sensor; and detecting, based on the output signal, an object present within a real-world environment; establishing wireless communication between the one or more processors and the object; obtaining, from the object via the wireless communication, operation status information characterizing status of a current operation of the object; determining a control option for the object based on the operation status information, wherein the control option is associated with effectuating a change in the current operation of the object conveyed by the operation status information; generating an overlay image comprising a visual effect, the visual effect indicating the control option; effectuating displaying of the overlay image including the visual effect on an augmented reality display; detecting, based on the output signals, a landmark within the field of view of the image sensor; determining, based on detection of the landmark within the field of view of the image sensor, that a user is performing an action of directing the field of view of the image sensor to the landmark; detecting, based on performance of the action of directing the field of view of the image sensor to the landmark and the landmark being related to the control option, user input by the user conveying selection of the control option; responsive to the detecting the user input, generating control information including instructions to effectuate the change in the current operation of the object; and effectuating transmission, from the one or more processors to the object via the wireless communication, of the control information so that the object effectuates the change in the current operation of the object.