METHODS AND DEVICES FOR OPTIMIZING MACHINE LEARNING MODEL COMPACTNESS AND ACCURACY THROUGH HARDWARE LATENCY HYSTERESIS EFFECT

摘要

A method for training a machine learning model, including acquiring an initial machine learning model, updating features of the initial machine learning model, updating dimension of the initial machine learning model based on the updated features of the initial machine learning model and one or more latency hysteresis points obtained based on a hardware profile of an accelerator configured to perform machine learning operations, and generating a final machine learning model based on the updated dimensions.