Parallelization of Irregular Out-of-Core Applications for Distributed-Memory Systems

摘要

Large scale irregular appliations involve data arrays and other data structures that are too large to fit in main memory and hence reside on disks; such applications are called out-of-core applications. This paper presents techniques for implementing this kind of applications. In particular we present a design for a runtime system to efficiently support parallel execution of irregular out-of-ocre coes on distributed-memeory systems. Furthermore, we describe the appropriate proram transformations required to reduce the I/O overheads for staging data as well as for communication while maintaining load balance. The proposed techniquecan be used by a parallelizing compiler or by users writing programs in node+message passing style. We have done a preliminary implementation of the techniques presented here. We introduce experimental results from a tempalte CFD code to demonstrate the efficacy of the presented techniques.