首页> 外文会议>IEEE International Conference on Cluster Computing >Clover: A Distributed File System of Expandable Metadata Service Derived from HDFS
【24h】

Clover: A Distributed File System of Expandable Metadata Service Derived from HDFS

机译:三叶草:从HDFS派生的可扩展元数据服务的分布式文件系统

获取原文

摘要

To store and manage data efficiently is the critical issue which modern information infrastructures confront with. To accommodate the massive scale of data in the Internet environment, most common solutions utilize distributed file systems. However there still exist disadvantages preventing these systems from delivering satisfying performance. In this paper, we present a Name Node cluster file system based on HDFS, which is named Clover. This file system exploits two critical features: an improved 2PC protocol which ensures consistent metadata update on multiple metadata servers and a shared storage pool which provides robust persistent metadata storage and supports the operation of distributed transactions. Clover is compared with HDFS and its key virtues are shown. Further experimental results show our system can achieve better metadata expandability ranging from 10% to 90% by quantized metrics when each extra server is added, while preserving similar I/O performance.
机译:为了高效地存储和管理数据是现代信息基础架构对抗的关键问题。为了适应互联网环境中的大规模数据,大多数常见的解决方案利用了分布式文件系统。然而,仍然存在缺点,防止这些系统提供了满足性能。在本文中,我们介绍了一个基于HDFS的名称节点群集文件系统,该文件名为Clover。此文件系统利用两个关键特性:改进的2PC协议,可确保在多个元数据服务器和共享存储池中的一致元数据更新,该存储池提供鲁棒持久元数据存储,并支持分布式事务的操作。将三叶草与HDFS进行比较,并显示其关键美德。进一步的实验结果表明,当添加每个额外服务器时,我们的系统可以通过量化度量来实现从10%到90%的更好的元数据可扩展性,同时保持类似的I / O性能。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号