BENCHMARK ANALYSIS FOR ADVANCED DISTRIBUTED DATA STORAGE FOR HETEROGENEOUS CLUSTERS

摘要

The necessity of a Large Scale Distributed Data Storage System offering scalability, reliability, performance, availability, affordability and manageability became a strong requirement for high-level application with multiple user interactions. This paper presents the benchmarking for performance of LUSTRE file system and highlights the results obtained from different test scenarios with IOzone and Intel IMB benchmarks, considering parallel I/O characteristics of Lustre file system. The paper also presents a set of best practices for data integrity security and accessibility and a few techniques for troubleshooting with LUSTRE. The results of the benchmark analysis were used to offer a perspective about the performance of NCIT-Cluster at University Politehnica of Bucharest in I/O and MPI jobs.