首页> 外文会议>Conference on Computing in High Energy and Nuclear Physics >Rucio - The next generation of large scale distributed system for ATLAS Data Management
【24h】

Rucio - The next generation of large scale distributed system for ATLAS Data Management

机译:Rucio - 用于图标数据管理的下一代大规模分布式系统

获取原文

摘要

Rucio is the next-generation Distributed Data Management (DDM) system benefiting from recent advances in cloud and "Big Data" computing to address HEP experiments scaling requirements.Rucio is an evolution of the ATLAS DDM system Don Quijote 2 (DQ2), which has demonstrated very large scale data management capabilities with more than 140 petabytes spread worldwide across 130 sites, and accesses from 1,000 active users.However, DQ2 is reaching its limits in terms of scalability, requiring a large number of support staff to operate and being hard to extend with new technologies.Rucio will deal with these issues by relying on a conceptual data model and new technology to ensure system scalability, address new user requirements and employ new automation framework to reduce operational overheads.We present the key concepts of Rucio, including its data organization/representation and a model of how to manage central group and user activities.The Rucio design, and the technology it employs, is described, specifically looking at its RESTful architecture and the various software components it uses.We show also the performance of the system.
机译:Rucio是从云中的最近进步和“大数据”计算的下一代分布式数据管理(DDM)系统,以解决HEP实验缩放要求.Rucio是ATLAS DDM系统的演变,它有一个(DQ2),它有在130个站点上展示了具有超过140个Petabytes的大规模数据管理功能,并从1,000个活跃的用户访问。然而,DQ2在可扩展性方面达到其限制,需要大量的支持人员运营和努力用新技术扩展.Rucio将通过依靠概念数据模型和新技术来处理这些问题,以确保系统可扩展性,满足新的用户需求,并采用新的自动化框架来减少运营开销.WE呈现Rucio的关键概念,包括其数据组织/表示和如何管理中央组和用户活动的模型。Rucio设计和它所雇用的技术是描述了,专门查看其宁静的架构和它使用的各种软件组件。我们也显示了系统的性能。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号