System and method of scheduling and computing resource allocation optimization of machine learning flows

摘要

A distributed machine learning optimization flow processing engine is proposed. The processing engine takes into account the structure of the programming to assign proper allocation within a distributed computing infrastructure. The processing engine also takes into account availability and loads of the different computing elements within the distributed infrastructure to maximize their utilization according to the software being executed.