AUTOMATED DISTRIBUTION OF MODELS FOR EXECUTION ON A NON-EDGE DEVICE AND AN EDGE DEVICE

摘要

Techniques for generating and executing an execution plan for a machine learning (ML) model using one of an edge device and a non-edge device are described. In some examples, a request for the generation of the execution plan includes at least one objective for the execution of the ML model and the execution plan is generated based at least in part on comparative execution information and network latency information.