Enhancing the Scalability of Blue Whale Cluster File System in Video-editing Environment

摘要

Scalability, which indicates the capacity of system to support the maximal number of clients, is very important to cluster file system. But in practical applications, the bandwidth that storage devices provide doesnpsilat linearly grow with the increasing number of clients which leads to bad QoS and restricts the scalability of cluster file system. This paper analyses the bottleneck of scalability of Blue Whale Cluster File System (BWFS) in video-editing application, and present a solution that clients employ the spare disk resource to cache data from remote server. By careful chosen of cache strategy and replacement algorithm, clients can access remote data from local disk, which significantly reduce random access to server and efficiently reduce the workload of storage servers. Therefore, the scalability of the whole system is significantly enhanced. We also implement a prototype to validate the solution and the result shows that it can enhance the scalability of the Blue Whale System by 80% at most.