Memory Contention in Scalable Cache-Coherent Multiprocessors

摘要

Effective use of large-scale multiprocessors requires the elimination of allbottlenecks that reduce processor utilization. One such bottleneck is memory contention. It is shown that memory contention occurs in many parallel applications, when those applications are run on large-scale shared-memory multiprocessors. In our simulations of several parallel applications on a large-scale machine, it was observed that some applications exhibit near-perfect speedup on hundreds of processors when the effect of memory contention is ignored, and exhibit no speedup at all when memory contention is considered. As the number of processors is increased, many applications exhibit an increase in both the number of hot spots and in the degree of contention for each hot spot. In addition, it was observed that hot spots are spread throughout memory for some applications, and that eliminating hot spots on an individual basis can cause other hot spots to worsen. These observations suggest that modern multiprocessors require some mechanism to alleviate hot-spet contention. The effectiveness of two different mechanisms for dealing with hot-spot contention indirect-connected, distributed-shared-memory multiprocessors is evaluated: queueing requests at the memory module, which allows a memory module to be more highly utilized during period of contention, and increasing the effective bandwidth to memory by having the coherency protocol distribute the hot data to multiple memory modules. It is shown that queueing requires long queues at each memory module, and does not perform as well as our proposed coherency protocol, which essentially eliminates memory contention in the applications considered.