首页> 外文会议>International Workshop on Personal Computers and Particle Accelerator Control >STATUS OF OPERATION DATA ARCHIVING SYSTEM USING Hadoop/HBase FOR J-PARC
【24h】

STATUS OF OPERATION DATA ARCHIVING SYSTEM USING Hadoop/HBase FOR J-PARC

机译:使用Hadoop / HBase用于J-PARC的操作数据归档系统的状态

获取原文

摘要

J-PARC (Japan Proton Accelerator Research Complex) consists of much equipment. In the Linac and the 3 GeV rapid cycling synchrotron ring (RCS) in J-PARC, data of about 64,000 EPICS records have been collected for control of these equipment. The data volume is about 2 TB every year, and the total data volume stored has reached about 10 TB. The data have been being stored by a Relational Database (RDB) system using PostgreSQL since 2006 in PostgreSQL, but it is becoming that PostgreSQL is not enough in availability, performance, and flexibility for our increasing data volume. We are planning to replace PostgreSQL with Apache Hadoop and Apache HBase to accumulate enormous operation data produced from the Linac and the RCS in JPARC. HBase is so-call NoSQL, which has scalability to data size at the cost of the high broad utility of SQL. HBase is constructed on a distributed file system provided by Hadoop, a cluster with advantages including automatically covering its cluster nodes' breakdowns and easily adding new nodes to expand its capacity. The new database system satisfies high availability, high performance, and high flexibility of storage expansion.
机译:J-PARC(日本质子加速器研究复合体)包括许多设备。在J-Parc中的Linac和3 GEV快速循环同步rotron(RCS)中,已收集约64,000史诗记录的数据,以控制这些设备。每年数据量约为2 TB,并且存储的总数据卷已达到约10 TB。自2006年在PostgreSQL中,使用PostgreSQL的关系数据库(RDB)系统存储了数据,但它正在成为我们不断增加的数据量的可用性,性能和灵活性的PostgreSQL。我们计划用Apache Hadoop和Apache HBase替换PostgreSQL,以累积从LINAC和JPARC中的RCS产生的巨大操作数据。 HBase是SO-Call NoSQL,它具有以SQL高广泛效用的成本为数据大小的可扩展性。 HBase是在Hadoop提供的分布式文件系统上构建,该集群具有优势,包括自动覆盖其群集节点的故障,并轻松添加新节点以扩展其容量。新的数据库系统满足高可用性,高性能和高度的存储扩展灵活性。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号