A High Energy Physical Metadata Directory Structure Based on RAMCloud

摘要

In recent years, with the large-scale growth of the high-energy physics experimental data, the performance of metadata retrieval based on disk storage has been gradually reduced, which can not meet the retrieval performance requirements of EB-level high-energy physics experimental metadata. To solve this problem, a method of converting traditional directory structure storage into RAMCloud storage is proposed. The core idea of this method is to use Key-Value non-relational database to re-design the traditional directory tree, separate directory structure and directory node content, and add a secondary index for parent directory, which can give full play to Key-Value retrieval and memory storage advantages, improve search efficiency. Through the implementation of the test, showed that the method has a better performance. Compared to the storage based on Mysql, the retrieval time drops significantly in the case of increased data.