首页> 外文会议>IEEE International Symposium on Parallel and Distributed Processing >DAGuE: A generic distributed DAG engine for high performance computing
【24h】

DAGuE: A generic distributed DAG engine for high performance computing

机译:DAGUE:用于高性能计算的通用分布式DAG引擎

获取原文

摘要

The frenetic development of the current architectures places a strain on the current state-of-the-art programming environments. Harnessing the full potential of such architectures has been a tremendous task for the whole scientific computing community. We present DAGuE a generic framework for architecture aware scheduling and management of micro-tasks on distributed many-core heterogeneous architectures. Applications we consider can be represented as a Direct Acyclic Graph of tasks with labeled edges designating data dependencies. DAGs are represented in a compact, problem-size independent format that can be queried on-demand to discover data dependencies, in a totally distributed fashion. DAGuE assigns computation threads to the cores, overlaps communications and computations and uses a dynamic, fully-distributed scheduler based on cache awareness, data-locality and task priority. We demonstrate the efficiency of our approach, using several micro-benchmarks to analyze the performance of different components of the framework, and a Linear Algebra factorization as a use case.
机译:目前架构的漂移开发在目前的最先进的编程环境中占据了一种应变。利用这种架构的全部潜力对于整个科学计算界来说是一个巨大的任务。我们在分布式多核异构架构上展示了造型的架构意识调度和管理微型任务的通用框架。我们考虑的应用程序可以表示为具有标记边缘的任务的直接非线性图形,指定数据依赖项。 DAG以紧凑,问题尺寸的独立格式表示,可以按要求查询以以完全分布的方式发现数据依赖性。 DAGUE将计算线程分配给核心,与通信和计算重叠,并使用基于高速缓存感知,数据局部性和任务优先级的动态完全分布的调度程序。我们展示了我们的方法的效率,使用多个微基准来分析框架的不同组件的性能,以及作为用例的线性代数分解。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号