Hierarchical data integrity verification of erasure coded data in a distributed computing system

摘要

Various methods, computer storage media, and systems for implementing hierarchical data integrity verification, in distributed computing systems, are provided. A data manager operates to perform hierarchical data integrity verification operations on message-digests that are associated based on a linear property of a non-cryptographic function, such that a data integrity of source data is verifiable based on the message-digests combined based on an exclusive-or (XOR) operator. The data manager accesses data fragments that are erasure coded fragments and a parity fragment generated from the data fragments, which correspond to source data. The data manager generates and stores the data-fragment message-digests, data-parity message-digests, and parity-fragment message-digests in corresponding data fragment zones and parity fragment zones. The data manager executes two different types of hierarchical data integrity verification operations, to verify the data integrity of the source data, the operations include: local data integrity verification operations, and global data integrity verification operations.