Worldwide Flock of Condors: Load Sharing among Workstation Clusters

摘要

Condor is a distributed batch system for sharing the workload of compute-intensive jobs in a pool of Unix workstations connectd by a network. In this paper, we describe the design and implementation of a distributed, layered Condor flocking mechanism. The main concept in this design is the Gateway Machine that represents in each pool idle machines from other pools in the flock and allow job transfer across pool boundaries. We also discuss our experiences with an intercontinental Condor flock.