...
首页> 外文期刊>IEEE Transactions on Parallel and Distributed Systems >A unified framework for optimizing communication in data-parallel programs
【24h】

A unified framework for optimizing communication in data-parallel programs

机译:在数据并行程序中优化通信的统一框架

获取原文
获取原文并翻译 | 示例

摘要

This paper presents a framework, based on global array data-flow analysis, to reduce communication costs in a program being compiled for a distributed memory machine. We introduce available section descriptor, a novel representation of communication involving array sections. This representation allows us to apply techniques for partial redundancy elimination to obtain powerful communication optimizations. With a single framework, we are able to capture optimizations like (1) vectorizing communication, (2) eliminating communication that is redundant on any control flow path, (3) reducing the amount of data being communicated, (4) reducing the number of processors to which data must be communicated, and (5) moving communication earlier to hide latency, and to subsume previous communication. We show that the bidirectional problem of eliminating partial redundancies can be decomposed into simpler unidirectional problems even in the context of an array section representation, which makes the analysis procedure more efficient. We present results from a preliminary implementation of this framework, which are extremely encouraging, and demonstrate the effectiveness of this analysis in improving the performance of programs.
机译:本文提出了一个基于全局阵列数据流分析的框架,该框架可降低为分布式存储计算机编译的程序中的通信成本。我们介绍可用的节描述符,这是涉及数组节的通信的一种新颖表示。这种表示方式使我们可以应用消除部分冗余的技术来获得强大的通信优化。有了一个单一的框架,我们就能捕获到以下优化:(1)向量化通信,(2)消除任何控制流路径上的冗余通信,(3)减少要通信的数据量,(4)减少通信量数据必须与之通信的处理器,以及(5)提前进行通信以隐藏等待时间并包含先前的通信。我们表明,即使在数组截面表示的情况下,消除部分冗余的双向问题也可以分解为更简单的单向问题,这使分析过程更加有效。我们提供了该框架初步实施的结果,这是非常令人鼓舞的,并证明了这种分析在提高计划绩效方面的有效性。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号