Distributed heterogeneous storage based on data value

摘要

The rapid development of the Internet and the arrival of the big data age, triggered the storage problem of the massive data. Traditional storage systems have difficult to solve the storage problems of big data, it constitutes heterogeneous storage hierarchy for the distributed storage based on the domestic server usually configured with a larger capacity of solid state drive and hard disk drive, providing the best solution for the storage problem of big data. In this paper, we introduced and redefined the data value, and proposed the heterogeneous storage architecture based on the data value, which can dynamically calculate the data value and choose the appropriate storage strategy according to the different data value and improve the overall performance of the system. Finally, the paper compares and analysis the performance for different strategies and values based on the hadoop distributed file system.