【24h】

Smart read/write for MPI-IO

机译:MPI-IO的智能读/写

获取原文

摘要

We present a case for automating the selection of MPI-IO performance optimizations, with an ultimate goal to relieve the application programmer from these details, thereby improving their productivity. Programmers productivity has always been overlooked as compared to the performance optimizations in high performance computing community. In this paper we present RFSA, a reduced function set abstraction based on an existing parallel programming interface (MPI-IO) for I/O. MPI-IO provides high performance I/O function calls to the scientists/engineers writing parallel programs; who are required to use the most appropriate optimization of a specific function, hence limits the programmer productivity. Therefore, we propose a set of reduced functions with an automatic selection algorithm to decide what specific MPI-IO function to use. We implement a selection algorithm for I/O functions like read, write, etc. RFSA replaces 6 different flavors of read and write functions by one read and write function. By running different parallel I/O benchmarks on both medium-scale clusters and NERSC supercomputers, we show that RFSA functions impose minimal performance penalties.
机译:我们提出了一种自动选择MPI-IO性能优化的案例,其最终目标是使应用程序员摆脱这些细节的困扰,从而提高他们的生产率。与高性能计算社区中的性能优化相比,程序员的生产力一直被忽视。在本文中,我们提出了RFSA,这是一种基于现有I / O并行编程接口(MPI-IO)的简化功能集抽象。 MPI-IO为编写并行程序的科学家/工程师提供高性能的I / O功能调用;需要使用特定功能最合适的优化的用户,因此限制了程序员的工作效率。因此,我们提出了一组具有自动选择算法的简化功能,以决定使用哪种特定的MPI-IO功能。我们为I / O功能(例如读,写等)实现选择算法。RFSA用一个读和写功能替换了6种不同的读和写功能。通过在中型集群和NERSC超级计算机上运行不同的并行I / O基准测试,我们证明RFSA功能对性能的影响最小。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号