Heterogeneous computing system and method including analyzing expected costs of compute kernels

摘要

A heterogeneous computing system and computer-implemented method are disclosed. In one example, the method includes initializing a first processing unit of a heterogeneous computing system with a first compute kernel and a second processing unit of the heterogeneous computing system with a second compute kernel. Both the first compute kernel and the second compute kernel are configured to perform a numerical operation derived from a program segment. In one example, the method includes one of executing the first compute kernel on the first processing unit to perform a numerical operation on the runtime instance if the first expected costs are lower than or equal to the second expected costs, and executing the second compute kernel on the second processing unit to perform a numerical operation on the runtime instance if the first expected costs are higher than the second expected costs.