Outer Rim Archives
Archives · 2018 · 9881273

Granted patent

Automatic object detection and state estimation via electronic emissions sensing

Number
9881273
Published
2018-01-30
Filed
2015-10-28
Assignee
DISNEY INTERPRISES, INC.; CARNEGIE MELLON UNIVERSITY
Inventors
Yang; Chouchang et al.
CPC
G06Q10/0833; G06K7/00; H04M1/72454; H04M1/725
Verdict
Set aside device emissions sensing for state estimation, business ops/tracking
Source
Google Patents · FreePatentsOnline

Abstract

An object recognition device that senses electrical signals conducted by the body of a human user (e.g., as a result of direct contact with or close proximity to a device emitting or conducting electromagnetic noise), compares the sensed electrical signals to a plurality of signatures of electrical signals produced by a corresponding plurality of types of electrical and electromechanical devices to determine the type of electrical or electromechanical device that generated the electrical signals sensed by the sensor, and communicates information to the human user related to or triggered by the electrical or electromechanical device.

Background

BACKGROUND(1) For years, intelligent systems have promised to improve people's lives by inferring context and activities in diverse environments. In particular, people's interactions with objects offer rich, contextual information closely reflecting one's immediate environment and activity. Yet practical detection and recognition of object interactions has remained an elusive research goal. For example, although RFID systems can provide object recognition capabilities, the use of such systems requires all desired objects to be physically tagged with an RFID tag and, further, it is unknown if users are simply nearby or truly touching an object.(2) Electronic devices, especially those driven by motors (e.g., power drills) or switching power supplies (e.g., LCD screens), produce significant levels of electromagnetic noise. These unwanted signals propagate as radio frequency (RF) waves and can disrupt nearby devices operating with similar frequency bands. Beginning in the late 1970s, the US Federal Communications Commission (FCC) chartered mandates to regulate the susceptibility of consumer devices to EM noise. These were also established to prevent EM noise from interfering with other electronics, utilities, and purposeful broadcasts, such as TV and radio.(3) Infrastructures and environments also produce EM noise. For example, AC electricity and devices connected to power lines contribute to the majority of electrical noise at home. In general, EM noise propagates through conduc

Claims

1. A recognition device carried or worn by a human user, the recognition device comprising: a sensor that senses electrical signals conducted by the body of the human user, wherein the electrical signals are a result of electromagnetic energy emitted by an electrical device in proximity to the human user; and a controller receptive of the electrical signals sensed by the sensor, the controller including a plurality of signatures for electrical signals produced by a corresponding plurality of types of electrical devices, the controller comparing the electrical signals sensed by the controller to the plurality of signatures to determine the type of electrical device that generated the electrical signals sensed by the sensor. 21. A method of recognizing objects touched or in proximity with a human user, the method comprising: periodically measuring electromagnetic signals being conducted in the human user; comparing the measured electromagnetic signals to a library of electromagnetic signal signatures, wherein each signature corresponds to a different type of electrical device, further including determining background electromagnetic signals and subtracting a value related to the background electromagnetic signals from the measured electromagnetic signals to provide background-adjusted measured electromagnetic signals to be used in the comparison; based on the comparison, determining what type of electrical device the human user is in contact with; and providing information to the human user based at least in part on the type of electrical device that the human user is in contact with. 22. A recognition device, comprising: a sensor that senses electrical signals conducted by the body of the human user, wherein the electrical signals are a result of electromagnetic energy emitted by an electrical device in proximity to the human user; a controller receptive of the electrical signals sensed by the sensor, the controller including a plurality of signatures for electrical signals produced by a corresponding plurality of types of electrical devices, the controller comparing the electrical signals sensed by the controller to the plurality of signatures to determine the type of electrical device that generated the electrical signals sensed by the sensor; and a user feedback device that provides information to a human user based on the determined type of electrical device. 23. A recognition device carried or worn by a human user, the recognition device comprising: a sensor that senses electrical signals conducted by the body of the human user; and a controller receptive of the electrical signals sensed by the sensor, the controller including a plurality of signatures for electrical signals produced by a corresponding plurality of types of electrical devices, the controller comparing the electrical signals sensed by the controller to the plurality of signatures to determine the type of electrical device that generated the electrical signals sensed by the sensor, wherein the controller includes a receiver to receive RF electrical signals conducted by the body of the human user, wherein the receiver is selected from a group consisting of a direct digital conversion receiver and a software-defined radio.