首页> 外文期刊>EPJ Web of Conferences >An http data-federation ecosystem with caching functionality using DPM and Dynafed
【24h】

An http data-federation ecosystem with caching functionality using DPM and Dynafed

机译:使用DPM和Dynafed具有缓存功能的http数据联合生态系统

获取原文
获取外文期刊封面目录资料

摘要

The implementation of cache systems in the computing model of HEP experiments enables to accelerate access to hot data sets by scientists, opening new scenarios of data distribution and enable to exploit the paradigm of storage-less sites. In this work, we present a study for the creation of an http data-federation ecosystem with caching functionality. We created plug-in integrated in the logic of a DPM Storage, able to reproduce a cache behaviour, taking advantage from the new feature introduced in the last version of Disk Pool Manager, called volatile-pool. Then we used Dynafed as lightweight federation system to aggregate a set of standard Grid Storage together with the caching system. With the designed setup, clients asking for a file present on the Data-Grid are automatically redirected to the cache, if the cache is the closest storage, thanks to the action of the geo-plugin run by Dynafed. As proof of the concept, we tested the whole system in a controlled environment within the Belle II computing infrastructure using a set of files located in production Storage Elements. Preliminary results demonstrate the proper functionality of the logic and encourage continuing the work.
机译:在HEP实验的计算模型中实施缓存系统,可以加速科学家对热数据集的访问,打开新的数据分发场景,并可以利用无存储站点的范例。在这项工作中,我们提出了一项有关创建具有缓存功能的http数据联合生态系统的研究。我们创建了与DPM存储的逻辑集成的插件,能够利用磁盘池管理器最新版本(称为volatile-pool)中引入的新功能来重现缓存行为。然后,我们使用Dynafed作为轻量级联合系统,将一组标准Grid Storage与缓存系统聚合在一起。通过设计的设置,如果缓存是最近的存储设备,则由于Dynafed运行的地理插件的作用,要求数据网格中存在文件的客户端会自动重定向到缓存。作为该概念的证明,我们使用位于生产存储元素中的一组文件在Belle II计算基础架构内的受控环境中测试了整个系统。初步结果证明了逻辑的正确功能,并鼓励继续进行工作。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号