Checkpointing for GPU-as-a-service in cloud computing environment

摘要

Techniques are provided to configure a graphics processing unit (GPU) service platform to provide GPU processing and checkpointing services to a client system. For example, when the GPU service platform receives a service request from a first client system for GPU processing services, a GPU server node is allocated to execute a first GPU processing task associated with the service request using one or more GPU devices. When a GPU checkpointing operation is performed during execution of the first GPU processing task to generate a checkpoint image of a current state of the first GPU processing task, the GPU server node is configured to execute at least a portion of a second GPU processing task associated with a second service request received from a second client system, using the one or more GPU devices concurrently with performing the GPU checkpointing operation for the first GPU processing task.