首页> 外文期刊>IEEE Transactions on Parallel and Distributed Systems >High-level buffering for hiding periodic output cost in scientific simulations
【24h】

High-level buffering for hiding periodic output cost in scientific simulations

机译:高级缓冲,可隐藏科学仿真中的定期产出成本

获取原文
获取原文并翻译 | 示例

摘要

Scientific applications often need to write out large arrays and associated metadata periodically for visualization or restart purposes. In this paper, we present active buffering, a high-level transparent buffering scheme for collective I/O, in which processors actively organize their idle memory into a hierarchy of buffers for periodic output data. It utilizes idle memory on the processors, yet makes no assumption regarding runtime memory availability. Active buffering can perform background I/O while the computation is going on, is extensible to remote I/O for more efficient data migration, and can be implemented in a portable style in today's parallel I/O libraries. It can also mask performance problems of scientific data formats used by many scientists. Performance experiments with both synthetic benchmarks and real simulation codes on multiple platforms show that active buffering can greatly reduce the visible I/O cost from the application's point of view.
机译:科学应用程序通常需要定期写出大数组和关联的元数据以进行可视化或重新启动。在本文中,我们介绍了主动缓冲,这是一种用于集体I / O的高级透明缓冲方案,其中,处理器主动将其空闲内存组织到用于定期输出数据的缓冲区层次结构中。它利用处理器上的空闲内存,但不对运行时内存的可用性做任何假设。主动缓冲可以在计算进行时执行后台I / O,可以扩展到远程I / O以实现更高效的数据迁移,并且可以在当今的并行I / O库中以可移植的方式实现。它还可以掩盖许多科学家使用的科学数据格式的性能问题。在多个平台上使用综合基准测试和实际仿真代码进行的性能实验表明,从应用程序的角度来看,主动缓冲可以大大降低可见的I / O成本。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号