Automated Hardware Resource Optimization

Number: 20210389989
Published: 2021-12-16
Filed: 2020-06-12
Assignee: Disney Enterprises, Inc.
Inventors: Farre Guiu; Miquel Angel, Martin; Marc Junyent, Pujol; Jordi Badia
CPC: G06F9/5016; G06F9/5011; G06N3/08; G06F9/44505; G06F9/4881; G06F9/5072; G06N3/045; G06N3/063
Verdict: Set aside IT hardware resource optimization, infra/business
Source: Google Patents · FreePatentsOnline

Abstract

An automated hardware resource optimization system includes a computing platform having a hardware processor and a system memory storing a software code. The hardware processor is configured to execute the software code to identify computing hardware for hosting a neural network based application, determine, based on a first performance parameter of the computing hardware, a batch size for performing data processing using the neural network based application, and tune, using a data batch having the determined batch size, a second performance parameter of the computing hardware to enable substantially continuous loading of its hardware processor memory. The software code also optimizes, based on the determined batch size and the tuned second performance parameter, a process flow for performing the data processing, and generates a configuration file identifying the computing hardware, the neural network based application, the determined batch size, the tuned second performance parameter, and the optimized process flow.

Background

BACKGROUND

An artificial neural network, also known simply as a neural network, is a type of machine learning framework in which patterns or learned representations of observed data are processed using highly connected computational layers that map the relationship between inputs and outputs. A “deep neural network,” in the context of deep learning, can refer to a neural network that utilizes multiple hidden layers between input and output layers, which may allow for learning based on features not explicitly defined in raw data. Various forms of neural networks may be used to make predictions about new data based on past examples or “training datasets.” In various implementations, deep neural networks may be trained as classifiers and may be utilized to perform image processing or natural-language processing, for example.

Deep neural network based applications typically require powerful computing resources for training and at run time. Moreover, such applications usually have resource-consuming preprocessing steps. As a result, it is important to properly dimension and configure the computing hardware on which those neural network based applications are to be trained or run. However, the hardware that hosts a neural network based application can be heterogeneous hardware resources having a variety of different hardware configurations. Furthermore, the hardware computing environment in which a neural network based application is executed may be shared with other

Claims

1. An automated hardware resource optimization system comprising: a computing platform including a hardware processor and a system memory storing a software code: the hardware processor configured to execute the software code to: identify a computing hardware for hosting a neural network based application; determine, based on a first performance parameter of the computing hardware, a batch size for performing data processing using the neural network based application; tune, using a data batch having the determined batch size, a second performance parameter of the computing hardware to enable substantially continuous loading of a hardware processor memory of the computing hardware; optimize, based on the determined batch size and the tuned second performance parameter, a process flow for performing the data processing using the neural network based application; and generate a configuration file identifying the computing hardware, the neural network based application, the determined batch size, the tuned second performance parameter, and the optimized process flow. || 11. A method for use by an automated hardware resource optimization system including a computing platform having a hardware processor and a system memory storing a software code, the method comprising: identifying, by the software code executed by the hardware processor, a computing hardware for hosting a neural network based application; determining, by the software code executed by the hardware processor and based on a first performance parameter of the computing hardware, a batch size for performing data processing using the neural network based application; tuning, by the software code executed by the hardware processor and using a data batch having the determined batch size, a second performance parameter of the computing hardware to enable substantially continuous loading of a hardware processor memory of the computing hardware; optimizing, by the software code executed by the hardware processor and based on the determined batch size and the tuned second performance parameter, a process flow for performing the data processing using the neural network based application; and generating, by the software code executed by the hardware processor, a configuration file identifying the computing hardware, the neural network based application, the determined batch size, the tuned second performance parameter, and the optimized process flow.