Outer Rim Archives
Archives · 2026 · 12639982

Granted patent

Predicting a need for assistance by determining behavior based on machine learning model analysis of video data

Number
12639982
Published
2026-05-26
Filed
2023-09-11
Assignee
Disney Enterprises, Inc.
Inventors
Hale; Gregory Brooks, Markowitz; Gary D., Wilkinson; Clifford Aron, Chen; Ching-Chien
CPC
G06V40/20; G06V40/28; G06V20/41; G06V20/52; G06V40/10; G06V40/1365; G09B19/003; G06V40/10; G06V40/18
Verdict
Low Hardware
First reported
2026-W29 (2026-07-15)
Source
Google Patents · FreePatentsOnline

The keeper's note

A behavior detection platform may obtain video data of an environment including a guest and may determine a set of normal guest behaviors associated with the environment.

Abstract

A behavior detection platform may obtain video data of an environment including a guest and may determine a set of normal guest behaviors associated with the environment. The platform may analyze, using a first machine learning model, the video data to identify features of the guest and analyze, using a second machine learning model, the video data and the features to determine an actual guest behavior of the guest. The platform may predict, using the second machine learning model, a predicted guest behavior of the guest based on the actual guest behavior. The behavior detection platform may determine that at least one of the actual guest behavior or the predicted guest behavior is not included in the set of normal guest behaviors. The platform may cause assistance to be provided to the guest based on determining that the actual guest behavior or the predicted guest behavior are not included.

Background

BACKGROUND (1) Closed-circuit television (CCTV) is a system that includes video camera devices that provide signals (e.g., video feeds) to specified monitors located at a specified location. In this regard, a CCTV system differs from a broadcast television system that broadcasts signals to multiple monitors located at multiple locations. A CCTV system is typically used to perform surveillance of areas monitored by the video camera devices. SUMMARY (2) In some implementations, a method performed by a behavior detection platform includes obtaining video data of an environment that includes a guest; determining a set of normal guest behaviors associated with the environment; analyzing the video data, using a first machine learning model, to determine an actual guest behavior of the guest; predicting, using a second machine learning model, a predicted guest behavior of the guest, wherein the predicted guest behavior is predicted based on the actual guest behavior; determining that at least one of the actual guest behavior or the predicted guest behavior is not a normal guest behavior of the set of normal guest behaviors; and responding to the at least one of the actual guest behavior or the predicted guest behavior based on determining that the at least one of the actual guest behavior or the predicted guest behavior is not a normal guest behavior of the set of normal guest behaviors. (3) In some implementations, a device includes one or more processors configured to: obtain vide

Claims

1. A method comprising: obtaining, by one or more processors, video data of an environment that includes a person, the video data comprising a plurality of frames; determining, by the one or more processors, a set of normal behaviors associated with the environment; analyzing, by the one or more processors, with a first machine learning model, the video data to identify keypoints of the person; analyzing, by the one or more processors, with a second machine learning model, a first frame of the plurality of frames and one or more first keypoints of the keypoints of the person in the first frame to determine an actual behavior of the person; predicting, by the one or more processors, with the second machine learning model, a predicted behavior of the person, based at least partially on the actual behavior, a second frame of the plurality of frames, and one or more second keypoints of the person in the second frame; comparing, by the one or more processors, at least one of the actual behavior or the predicted behavior to the set of normal behaviors; and generating, by the one or more processors, a notification. || 8. A system, comprising: one or more cameras; and a behavioral platform comprising one or more processors configured to: obtain video data from the one or more cameras of an environment that includes a first person and a second person; analyze, with a first machine learning model, the video data, to identify at least one feature; analyze, with a second machine learning model using the at least one feature, the video data to determine a first actual behavior of the first person and a second actual behavior of the second person; predict, with the second machine learning model, a second predicted behavior of the second person based at least partially on the second actual behavior; determine that the first actual behavior is a first abnormal behavior with respect to a set of normal behaviors of people in the environment; determine that the second predicted behavior of the second person is a second abnormal behavior with respect to the set of normal behaviors; provide a notification indicating that assistance is to be provided to at least one of the first person or the second person in response to determining that at least one of the first actual behavior is the first abnormal behavior or the second predicted behavior is the second abnormal behavior. || 14. A non-transitory computer-readable medium comprising: one or more instructions that, when executed by one or more processors of a device, cause the device to: obtain video data of an environment that includes a person; analyze the video data with a first machine learning model; determine an actual behavior of the person in response to analyzing the video data; detect an occurrence of an unexpected event based at least partially on analyzing the video data; determine that the actual behavior is different from a set of normal behaviors of people in the environment; predict, with a second machine learning model, a predicted behavior of the person based on at least one of the unexpected event or the actual behavior; determine that assistance is to be provided to the person based at least partially on determining that the predicted behavior is different from the set of normal behaviors; and cause an action to be performed to provide assistance to the person.