STAGE-WISE MINI BATCHING TO IMPROVE CACHE UTILIZATION

摘要

A computer-implemented method is provided for neural network training. The method includes improving a cache utilization by one or more processors during multiple training stages of a neural network, by performing a stage-wise mini-batch process on a set of samples used for the multiple training stages. The stage-wise mini-batch process waits for each of the multiple training stages to complete using a system wait primitive to improve the cache utilization.