Storage devices, local file system and crossbar network file system characteristics, and 1 terabyte file I/O benchmark on the 'Numerical Simulator III'

摘要

We benchmarked a mass storage system, named "CeMSS", on the "Numerical Simulator III" system. It has 80 RAID-5 disk arrays and 40 LTO tape dives, as a storage devices, and has an HSM based local file system and crossbar network file system. We also described the CeMSS design outline. In order to clear our benchmark perspective we defined the "standard I/O characteristic" and "user 10 pattern". We recognized that the disk and tape devices of CeMSS are optimized at 2MB and 128+ [KB] I/O size. Using 16-way disks, user application programs can use over 1[GB/s] I/O throughput on the NS-III. Also, under the 80-way disk condition, CeMSS could operate a 1[TB] file within I/O minutes.