Efficient barrier synchronization in wormhole- routed mesh networks supporting turn model

摘要

Barrier is an important synchronization operation. On scalable parallel computers, it is often implemented as a collective communication. A typical barriers synchronization operation consists of a reduction operation followed by a distribution operation. In this paper, we in- troduce a systematic way of generating efficient algorithms to perform barrier synchronization in mesh networks. The scheme works with any base routing algorithm that is derivable from the turn model C.J. Glass, L.M.Ni, in: Proc.Intl.Symp. Computer Architecture, pp.278-297.