Benchmarking and Testing OSD for Correctness and Compliance

摘要

Developers often describe testing as being tedious and boring. This work challenges this notion; we describe tools and methodologies crafted to test object-based storage devices (OSDs) for correctness and compliance with the T10 OSD standard. A special consideration is given to test the security model of an OSD implementation. Additionally, some work was carried out on building OSD benchmarks. This work can be a basis for a general-purpose benchmark suite for OSDs in the future, as more OSD implementations emerge. Originally designed to test performance, it was surprisingly useful for discovering unexpected peculiar behaviors and special type of bugs that are otherwise not considered bugs. The tool described here has been used to verify object-disks built by Seagate and IBM research.