首页> 外文会议>SC Companion: High Performance Computing, Networking, Storage and Analysis >Low-latency Memory-Mapped I/O for Data-Intensive Applications on Fast Storage Devices
【24h】

Low-latency Memory-Mapped I/O for Data-Intensive Applications on Fast Storage Devices

机译:低延迟内存映射I / O,用于快速存储设备上的数据密集型应用

获取原文

摘要

Thesedays, along with read()/write(), mmap() is used to file I/O in data-intensive applications as an alternative method of I/O on emerging low-latency device such as flash-based SSD. Although utilizing memory-mapped file I/O have many advantages, it does not produce much benefit when combined with large-scale data and fast storage devices. When the working set of an application accessing file with mmap() is larger than the size of physical memory, the I/O performance is severely degraded compared to the application with read/write(). This is mainly due to the virtual memory subsystem that does not reflect the performance feature of the underlying storage device. In this paper, we examined linux virtual memory subsystem and mmap() I/O path to figure out the influence of low-latency storage devices on the existing virtual memory subsystem. Also, we suggest some optimization policies to reduce the overheads of mmap() I/O and implement the prototype in a recent Linux kernel. Our solution guarantees that 1) memory-mapped I/O will be several times faster than read-write I/O when cache-hit ratio becomes high, and 2) the former will show at least the performance of the latter even when cache-miss frequently occurs and the overhead of mapping/unmapping pages becomes significant, which are not achievable by the existing virtual memory subsystem.
机译:如今,连同read()/ write(),mmap()一起用于数据密集型应用程序中的I / O归档,作为新兴的低延迟设备(如基于闪存的SSD)上I / O的替代方法。尽管利用内存映射文件I / O具有许多优点,但与大规模数据和快速存储设备结合使用时,它不会产生太大的好处。当使用mmap()访问文件的应用程序的工作集大于物理内存的大小时,与使用read / write()的应用程序相比,I / O性能会严重下降。这主要是由于虚拟内存子系统无法反映基础存储设备的性能特征。在本文中,我们检查了linux虚拟内存子系统和mmap()I / O路径,以了解低延迟存储设备对现有虚拟内存子系统的影响。另外,我们建议一些优化策略来减少mmap()I / O的开销,并在最近的Linux内核中实现原型。我们的解决方案保证了:1)当高速缓存命中率变高时,内存映射的I / O将比读写I / O快几倍; 2)前者将至少显示后者的性能,即使在高速缓存命中率较高时也是如此。经常会发生未命中,并且映射/取消映射页面的开销变得很重要,而现有的虚拟内存子系统无法实现。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号