Dynamic data declustering on SAN-connected PC cluster for parallel data mining

摘要

Recently, Personal Computer/Workstation (PC/WS) clusters have become a hot research topic because of their good scalability and cost performance ratio. In the viewpoint of applications, data intensive applications including data mining are considered very important for massively parallel processors. In this paper, a PC cluster connected with Storage Area Network (SAN) is built and evaluated. For disk-to-disk copy operation, SAN clusters are much better than LAN clusters. A data mining application is implemented on the cluster. In order to resolve the I/O-bottleneck problem, a dynamic data declustering method is proposed and evaluated. This method prevents the performance degradation caused by shared disk bottleneck in SAN clusters.