首页> 外文期刊>Journal of supercomputing >FITDOC: fast virtual machines checkpointing with delta memory compression
【24h】

FITDOC: fast virtual machines checkpointing with delta memory compression

机译:FITDOC:具有增量内存压缩功能的快速虚拟机检查点

获取原文
获取原文并翻译 | 示例

摘要

Virtualization provides the function of saving the entire status of the execution environment of a running virtual machine (VM), which makes checkpointing flexible and practical for HPC servers or data center servers. However, the system-level checkpointing needs to save a large number of data to the disk. Moreover, the overhead grows linearly with the increasing size of virtual machine memory, which leads to disk I/O consumption disaster along with poor system scalability. To target this, we propose a novel fast VM checkpointing approach, named Fast Incremental checkpoinTing with Delta memOry Compression (FITDOC). By studying the run-time memory characteristics of different workloads, FITDOC counts the dirty pages in a fine-granularity manner (i.e., the number of 8 bytes), instead of in the conventional method (i.e., the number of pages). FITDOC utilises a dirty page logging mechanism to record the dirty pages. Accordingly, a delta memory compression mechanism is implemented to eliminate redundant memory data in checkpointing files. To locate the dirty data in dirty pages, FITDOC utilizes two mechanisms: by analyzing the distribution characteristics of dirty pages in the dirty bitmap, we propose a fast dirty bitmap scanning method to locate the dirty pages, and take a multi-threading data comparison mechanism to locate the real dirty data in one page. The experimental results show that compared with Xen's default system-level checkpointing algorithm, FITDOC can on average reduce checkpointing time 70.54 % with a 1 GB memory size and achieve better improvement for VMs with larger memory configurations. FITDOC can reduce the size of checkpointing data 52.88 % on average compared with Remus's incremental solution, which is in page granularity. Compared with the default dirty bitmap scanning method in Xen, the scanning time of FITDOC is decreased by 91.13 % on average.
机译:虚拟化提供了保存正在运行的虚拟机(VM)的执行环境的整个状态的功能,这使HPC服务器或数据中心服务器的检查点灵活而实用。但是,系统级检查点需要将大量数据保存到磁盘。此外,开销随着虚拟机内存大小的增加而线性增加,这导致磁盘I / O消耗灾难以及系统可伸缩性差。为了解决这个问题,我们提出了一种新颖的快速VM检查点方法,即带有增量内存压缩的快速增量检查点(FITDOC)。通过研究不同工作负载的运行时内存特征,FITDOC以细粒度方式(即8字节数)而不是传统方法(即页数)对脏页进行计数。 FITDOC利用脏页日志记录机制来记录脏页。因此,实施增量存储器压缩机制以消除检查点文件中的冗余存储器数据。为了在脏页中定位脏数据,FITDOC利用两种机制:通过分析脏位图中脏页的分布特征,我们提出了一种快速的脏位图扫描方法来定位脏页,并采取了多线程数据比较机制。在一页中找到真正的脏数据。实验结果表明,与Xen的默认系统级检查点算法相比,FITDOC在1 GB内存大小的情况下平均可减少70.54%的检查点时间,并且对于具有更大内存配置的VM可以实现更好的改进。与Remus的增量解决方案(页面粒度)相比,FITDOC可以将检查点数据的大小平均减少52.88%。与Xen中默认的脏位图扫描方法相比,FITDOC的扫描时间平均减少了91.13%。

著录项

  • 来源
    《Journal of supercomputing》 |2016年第9期|3328-3347|共20页
  • 作者单位

    Huazhong Univ Sci & Technol, Sch Comp, Serv Comp Technol & Syst Lab, Cluster & Grid Comp Lab, Wuhan 430074, Peoples R China;

    Huazhong Univ Sci & Technol, Sch Comp, Serv Comp Technol & Syst Lab, Cluster & Grid Comp Lab, Wuhan 430074, Peoples R China;

    Huazhong Univ Sci & Technol, Sch Comp, Serv Comp Technol & Syst Lab, Cluster & Grid Comp Lab, Wuhan 430074, Peoples R China;

    Huazhong Univ Sci & Technol, Sch Comp, Serv Comp Technol & Syst Lab, Cluster & Grid Comp Lab, Wuhan 430074, Peoples R China;

    Huazhong Univ Sci & Technol, Sch Comp, Serv Comp Technol & Syst Lab, Cluster & Grid Comp Lab, Wuhan 430074, Peoples R China|St Francis Xavier Univ, Dept Comp Sci, Antigonish, NS B2G 2W5, Canada;

  • 收录信息 美国《科学引文索引》(SCI);美国《工程索引》(EI);
  • 原文格式 PDF
  • 正文语种 eng
  • 中图分类
  • 关键词

    Checkpointing; Memory compression; Dirty page; Dirty bitmap;

    机译:检查点;内存压缩;脏页;脏位图;

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号