SCHEDULING OF A PLURALITY OF GRAPHIC PROCESSING UNITS

摘要

The present disclosure provides a method and apparatus for scheduling a plurality of available graphics processing units (GPUs). Multiple GPU pools may be set, wherein each GPU pool is configured to serve one to serve one or more jobs requiring the same number of GPUs. Available GPUs may be assigned to each GPU pool. A job and job information related to the job may be received, wherein the job information indicates a number of GPUs required for performing the job. A corresponding GPU pool may be selected from the multiple GPU pools based at least on the job information. Available GPUs to be scheduled to the job in the selected GPU pool may be determined based at least on the job information. In addition, the determined available GPUs may be scheduled to the job.