Weighted-value consistent hashing for balancing device wear

摘要

Described are techniques that select a physical storage device for storing data. Device weights for physical storage devices are determined in accordance with factor(s) including a storage capacity each physical storage device and an amount of remaining write capacity of each physical storage device representing an amount of remaining writes for an expected lifetime of each physical storage device. A replica set is determined for each physical storage device in accordance with a device weight. Hash value sets are determined for the physical storage devices using a hash function. A first hash value for a first data item is determined using the hash function. The first hash value is mapped to a second hash value included in one of hash value sets associated with a corresponding one of the physical storage devices. The corresponding one of the physical storage devices is selected to store the first data item.