Smart accelerator allocation and reclamation for deep learning jobs in a computing cluster

摘要

Embodiments for accelerator allocation and reclamation for deep learning jobs in a computing cluster. Metrics are recorded of each accelerator of a set of accelerators allocated to a deep learning job including computing a gain of computational power by an additional allocation of new accelerators and computing a cost of transferring data among the new accelerators and the set of allocated accelerators. Ones of the new accelerators are allocated to the deep learning job or ones of the set of allocated accelerators assigned to perform the deep learning job are reclaimed upon determining an optimal accelerator topology by comparing the gain of computation power and the cost of transferring data.