Efficient Message Passing Interface (MPI) for Parallel Computing on Clusters of Workstations

摘要

Parallel computing on clusters of workstations and personal computers has very high potential, since it leverages existing hardware and software. Paralle programming environments offer the user a convenient way to express parallel computation and communication. In fact, recently, a Message Passing Interface (MPI) has been proposed as an industrial standard for writing "portable" message-passing parallel programs. The communication part of MPI consists of the usual point-to-point communication as well as collective communication. However, existing implementations of programming environments for clusters are built on top of a point-to-point communication layer (send and receive) over local area networks (LANs) and, as a result, suffer from poor performance in the collective communication part.