Provides an AR experience driven by an IoT objects operation status, triggering visual effects based on the detected object state.
This disclosure relates to systems and methods for using augmented reality with the internet of things. An augmented reality experience may be provided based on an operation of an object. Operation statusinformation of a detected object may be obtained and a visual effect may be determined based on the operation status information. An object may be controlled using augmented reality. Operation status information of a detected object may be obtained and a control optionmay be determined based on the operation status information. A visual effect may be determined based on the control option and a user input regarding the control option may be obtained. A control information configured to effectuate a change in the operation of the object may be transmitted to the object.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 illustrates a system for providing augmented reality experience based on an operation of an object.
FIG. 2 illustrates a system for controlling an object using augmented reality.
FIG. 3 illustrates an example of objects within a field of view of an image sensor.
FIG. 4 illustrates an example of visual effects based on the operation status information of objects.
FIG. 5 illustrates an example of visualeffects based on changes in the operation status information of objects.
FIG. 6 illustrates an example of visual effects based on control options for objects.
FIG. 7 illustrates a method for providing augmented reality experience based on an operation of anobject.DETAILED DESCRIPTION
FIG. 1 illustrates a system 1 for providing augmented reality experience based on an operation of an object. System 1 may include one or more of processor 11, display 12, image sensor 13, electronic storage 14, bus 15, and/or other components. To provide an augmented reality experience based on an operation of an object, anobject may be detected and a position and/or an orientation of the object may be determined. Operation status information may be obtained and a visual effect may be determined based on the operation status information. An overlay position and/or an overlay orientation for the visual effect may be determined and an overlay image including the visual effect may be determined. The overlay image
1. A system for providing augmented reality experience based on an operation of an object, the system comprising: a display configured to display an overlay image; a first image sensor configured to generate visual outputsignals conveying visual information within a field of view of the first image sensor; one or more processors configured by machine readable instructions to: detect the object based on the visual output signals; determine a position and/or an orientation of the object based on the visual output signals; obtain operation status information of the object; determine a first visual effect based on the operation status information; determine an overlay position and/or an overlay orientation for the first visual effect based on the position and/or the orientation of the object; determine the overlay image comprising the first visual effect, wherein the first visual effect is placed within the overlay image accordingto the overlay position and/or the overlay orientation for the first visual effect; and effectuate displaying of the overlay image on the display.
10. A method for providing augmented reality experience based on an operation of an object, the method comprising: generating visual output signals conveying visual information within a field of view of a first image sensor; detecting the object based on the visual output signals; determining a position and/or an orientation of the object based on the visual output signals; obtaining operation status information of the object; determining a first visual effect based on the operation status information; determining an overlay position and/or an overlay orientation for the first visual effect based on the position and/or the orientation of the object; determining an overlay image comprising the first visual effect, wherein the first visual effect is placed within the overlay image according to the overlay position and/or the overlayorientation for the first visual effect; and effectuating displaying of the overlay imageon a display.
19. A system for providing augmented reality experience based on an operation of an object, the system comprising: a display configured to display an overlay image; a first image sensor configured to generate visual output signals conveying visual information within a field of view of the first image sensor; a second image sensor configured totrack a position of an eye of a user; one or more processors configured by machine readable instructions to: determine a gaze direction of the eye of the user based on the position of the eye of the user; detect the object based on the visual output signals and based on the gaze direction of the eye of the user, wherein the object within the field of view of the first image sensor is detected when the gaze direction of the eye of the user is pointed towards the object; determine a position and/or an orientation of the object based onthe visual output signals; obtain operation status information of the object; determine afirst visual effect based on the operation status information; determine an overlay position and/or an overlay orientation for the first visual effect based on the position and/orthe orientation of the object; determine the overlay image comprising the first visual effect, wherein the first visual effect is placed within the overlay image according to the overlay position and/or the overlay orientation for the first visual effect; and effectuate displaying of the overlay image on the display.