首页> 外文OA文献 >Deferred lightweight indexing for log-structured key-value stores
【2h】

Deferred lightweight indexing for log-structured key-value stores

机译:延迟轻量级索引,用于日志结构键值存储

代理获取
本网站仅为用户提供外文OA文献查询和代理获取服务,本网站没有原文。下单后我们将采用程序或人工为您竭诚获取高质量的原文,但由于OA文献来源多样且变更频繁,仍可能出现获取不到、文献不完整或与标题不符等情况,如果获取不到我们将提供退款服务。请知悉。

摘要

© 2015 IEEE. The recent shift towards write-intensive workload on bigdata (e.g., financial trading, social user-generated data streams)has pushed the proliferation of log-structured key-value stores, represented by Google's BigTable [1], Apache HBase [2] andCassandra [3]. While providing key-based data access with aPut/Get interface, these key-value stores do not support value-based access methods, which significantly limits their applicability in modern web and database applications. In this paper, we present DELI, a DEferred Lightweight Indexing scheme on the log-structured key-value stores. To index intensively updated bigdata in real time, DELI aims at making the index maintenance as lightweight as possible. The key idea is to apply an append-only design for online index maintenance and to collect index garbage at carefully chosen time. DELI optimizes the performance of index garbage collection through tightly coupling its execution with a native routine process called compaction. The DELI'ssystem design is fault-tolerant and generic (to most key-valuestores), we implemented a prototype of DELI based on HBasewithout internal code modification. Our experiments show that the DELI offers significant performance advantage for the write-intensive index maintenance.
机译:©2015 IEEE。最近转向大数据写入密集型工作负载(例如,金融交易,社交用户生成的数据流),推动了以日志结构的键值存储的泛滥,这些存储由Google的BigTable [1],Apache HBase [2]和Cassandra代表[3]。这些键值存储在通过aPut / Get接口提供基于键的数据访问时,不支持基于值的访问方法,这大大限制了它们在现代Web和数据库应用程序中的适用性。在本文中,我们提出了DELI,一种对数结构键值存储的DEFERred轻量级索引方案。为了实时索引密集更新的大数据,DELI旨在使索引维护尽可能轻巧。关键思想是为联机索引维护应用仅附加设计,并在精心选择的时间收集索引垃圾。 DELI通过将索引的执行与称为压缩的本机例程进程紧密耦合来优化索引垃圾收集的性能。 DELI的系统设计是容错且通用的(对于大多数键值存储而言),我们实现了基于HBase的DELI原型,而无需内部代码修改。我们的实验表明,DELI为写入密集型索引维护提供了显着的性能优势。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
代理获取

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号