Energy-efficient algorithms for distributed storage system based on block storage structure reconfiguration

摘要

As the underlying core infrastructure for cloud computing, distributed storage systems like the Hadoop Distributed File System (HDFS) are the foundation of all kinds of cloud services. However, designers of the ever-expanding systems have ignored the problem of high energy consumption, causing serious environmental and economic problems. The data availability and performance duality of Service (QoS) requirements make it hard to use existing energy-saving technologies to solve the problem. After researching the data block's storage structure and mechanism, and the relationship between the server's status and the data block's availability, the method to solve the problem of ensuring data availability and performance QoS requirements is proposed. The energy-saving model for the distributed storage system is defined. The algorithm divides the RACK into two distinct storage areas, Active-Zone and Sleep-Zone, reconfiguring the data storage structure using the block storage structure reconfiguration algorithm. To save energy, we turn the servers in Sleep-Zone to sleep mode while the workload is low. Numerical analysis and experimental results demonstrate that the energy-efficient algorithms improved the energy efficiency for the distributed storage system.