首页> 外文会议>2012 IEEE International Conference on Cluster Computing. >Clover: A Distributed File System of Expandable Metadata Service Derived from HDFS
【24h】

Clover: A Distributed File System of Expandable Metadata Service Derived from HDFS

机译:Clover:源自HDFS的可扩展元数据服务的分布式文件系统

获取原文
获取原文并翻译 | 示例
获取外文期刊封面目录资料

摘要

To store and manage data efficiently is the critical issue which modern information infrastructures confront with. To accommodate the massive scale of data in the Internet environment, most common solutions utilize distributed file systems. However there still exist disadvantages preventing these systems from delivering satisfying performance. In this paper, we present a Name Node cluster file system based on HDFS, which is named Clover. This file system exploits two critical features: an improved 2PC protocol which ensures consistent metadata update on multiple metadata servers and a shared storage pool which provides robust persistent metadata storage and supports the operation of distributed transactions. Clover is compared with HDFS and its key virtues are shown. Further experimental results show our system can achieve better metadata expandability ranging from 10% to 90% by quantized metrics when each extra server is added, while preserving similar I/O performance.
机译:有效地存储和管理数据是现代信息基础架构面临的关键问题。为了在Internet环境中容纳海量数据,大多数常见的解决方案都使用分布式文件系统。但是,仍然存在一些缺点,妨碍了这些系统提供令人满意的性能。在本文中,我们提出了一个基于HDFS的名称节点群集文件系统,名为Clover。该文件系统利用两个关键功能:改进的2PC协议(确保在多个元数据服务器上进行一致的元数据更新)和共享存储池,该存储池提供可靠的持久性元数据存储并支持分布式事务的操作。将三叶草与HDFS进行了比较,并显示了其主要优点。进一步的实验结果表明,当添加每个额外的服务器时,通过量化指标,我们的系统可以实现更好的元数据可扩展性,范围从10%到90%,同时保持相似的I / O性能。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号