Outer Rim Archives
Archives · 2026 · 12639627

Granted patent

Training of machine learning models with hardware-in-the-loop simulations

Number
12639627
Published
2026-05-26
Filed
2022-09-01
Assignee
DISNEY ENTERPRISES, INC.
Inventors
Milluzzi; Andrew Jesse, Haslebacher; Faith Elizabeth Smith
CPC
G05B17/02; G06N20/00; G06F9/455; G05B2219/13186; G05B2219/14071; G05B2219/23446
Verdict
Medium Hardware
First reported
2026-W29 (2026-07-15)
Source
Google Patents · FreePatentsOnline

The keeper's note

A method for training a control system model includes introducing a simulated fault into a software simulation of a physical system and generating emulated sensor data based on the simulated fault, where the emulated se…

Abstract

A method for training a control system model includes introducing a simulated fault into a software simulation of a physical system and generating emulated sensor data based on the simulated fault, where the emulated sensor data emulates output from one or more sensors of the physical system. The method further includes obtaining output data from a test control system provided with the emulated sensor data, where the test control system emulates a control system of the physical system and tagging the output data with the simulated fault to create training data. The method further includes utilizing the training data to train the control system model, where the control system model is a machine learning model for use with the control system of the physical system during operation of the physical system.

Background

CROSS-REFERENCE TO RELATED APPLICATIONS (1) This application is related to U.S. Pat. No. 11,010,510, filed Apr. 30, 2019, entitled “SOFT-REAL-TIME HUB PROVIDING DATA TRANSPORT FOR PROCESSOR-IN-LOOP (PIL) SIMULATIONS,” and U.S. Pat. No. 11,366,945, filed May 3, 2021, entitled “SOFT-REAL-TIME HUB PROVIDING DATA TRANSPORT FOR PROCESSOR-IN-LOOP (PIL) SIMULATIONS,” the disclosures of which are incorporated herein by reference in their entireties for any purpose. BACKGROUND (2) Control systems are generally used to control complex mechanical and electromechanical systems. For example, theme park attractions, such as rollercoasters, rides, or the like, including control that monitor and actuate ride vehicles, and other aspects of the attraction may be controlled by control systems. Various control systems may also be used to assist in repair and/or maintenance of such systems, by identifying components within such systems in need of repair or replacement. However, control systems often evaluate the current state of a mechanical or electromechanical system and may not identify component malfunctions before they occur or before components need to be replaced for a system to remain operational. Further, such control systems may be unable to identify rare events occurring within a system, such as external physical conditions, system components that fail infrequently, and the like. (3) Control systems, including software controllers, are frequently used to control and monitor complex mec

Claims

1. A method comprising: introducing a simulated fault into a software simulation of a physical system, comprising: utilizing a Monte Carlo technique to generate random data representing the simulated fault; and utilizing the Monte Carlo technique to inject the random data into the software simulation at a random interval; generating emulated sensor data based on the simulated fault, the emulated sensor data emulating output from one or more sensors of the physical system; obtaining output data from a test control system provided with the emulated sensor data, the test control system emulating a control system of the physical system, wherein the output data comprises a simulated control signal generated by the test control system in response to the emulated sensor data; tagging the output data with the simulated fault to create training data; and utilizing the training data to train a control system model, the control system model being a machine learning model for use with the control system of the physical system during operation of the physical system. || 8. A system comprising: a software simulation system including a processor and memory for executing a software simulation of a physical system, the software simulation system being configured to generate emulated sensor data based on input to the software simulation system, the emulated sensor data emulating output from one or more sensors of the physical system, wherein the input to the software simulation system comprises a simulated fault of the physical system introduced to the software simulation by: utilizing a Monte Carlo technique to generate random data representing the simulated fault; and utilizing the Monte Carlo technique to inject the random data into the software simulation at a random interval; and a test control system emulating a control system of the physical system, the test control system configured to generate control system output based on the emulated sensor data, wherein the control system output comprises a simulated control signal generated by the test control system in response to the emulated sensor data. || 14. A method comprising: receiving, at a hardware-in-loop (HIL) simulation of a physical system, programmatic data input including at least one injected fault, the at least one injected fault being representative of a first physical condition in a physical system, the at least one injected fault being injected into the programmatic data input using a Monte Carlo technique, wherein injecting the at least one injected fault into the programmatic data input comprises: utilizing the Monte Carlo technique to generate random data representing the at least one injected fault; and utilizing the Monte Carlo technique to inject the random data into the programmatic data input at a random interval; generating, by the HIL simulation, control system outputs, the control system outputs corresponding to outputs of a control system controlling the physical system, wherein the control system outputs comprise simulated control signals generated by the HIL simulation in response to the at least one injected fault; generating a dataset by tagging the control system outputs using the programmatic data input including the at least one injected fault; and training a control model using the dataset, the control model being trained to identify the first physical condition in the physical system based on the outputs of the control system controlling the physical system.