首页> 外文期刊>IEEE Transactions on Parallel and Distributed Systems >Native data representation: An efficient wire format for high-performance distributed computing
【24h】

Native data representation: An efficient wire format for high-performance distributed computing

机译:本机数据表示:一种用于高性能分布式计算的有效有线格式

获取原文
获取原文并翻译 | 示例

摘要

New trends in high-performance software development such as tool- and component-based approaches have increased the need for flexible and high-performance communication systems. When trying to reap the well-known benefits of these approaches, the question of what communication infrastructure should be used to link the various components arises. In this context, flexibility and high-performance seem to be incompatible goals. Traditional HPC-style communication libraries, such as MPI, offer good performance, but are not intended for loosely-coupled systems. Object- and metadata-based approaches like XML offer the needed plug-and-play flexibility, but with significantly lower performance. We observe that the flexibility and baseline performance of data exchange systems are strongly determined by their wire formats, or by how they represent data for transmission in heterogeneous environments. After examining the performance implications of using a number of different wire formats, we propose an alternative approach for flexible high-performance data exchange, Native Data Representation, and evaluate its current implementation in the portable binary I/O library.
机译:高性能软件开发的新趋势,例如基于工具和基于组件的方法,已经增加了对灵活,高性能通信系统的需求。当试图获得这些方法的众所周知的好处时,出现了一个问题,即应该使用哪种通信基础结构来链接各个组件。在这种情况下,灵活性和高性能似乎是不兼容的目标。传统的HPC风格的通信库(例如MPI)可提供良好的性能,但不适用于松耦合的系统。 XML等基于对象和基于元数据的方法提供了所需的即插即用灵活性,但性能却大大降低。我们观察到,数据交换系统的灵活性和基准性能在很大程度上取决于它们的线路格式,或者取决于它们如何表示在异构环境中传输的数据。在研究了使用多种不同线路格式对性能的影响之后,我们提出了一种灵活的高性能数据交换的替代方法,即“本机数据表示”,并评估了其在便携式二进制I / O库中的当前实现。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号