FIXED CHUNK SIZE DEDUPLICATION WITH VARIABLE-SIZE CHUNKING

摘要

A computer-implemented method includes positioning a sliding window over a string of data and calculating a hash value using a rolling hash function for data encompassed by the sliding window. The method includes determining whether the calculated hash value for the data encompassed by the sliding window matches the value of an element in a cut point candidate (CPC) array by comparing the calculated hash value to the value of a first element in the CPC array. In response to the calculated hash value being equal to the value of the first element in the CPC array, the method includes defining an index of the sliding window as the cutting point for a data block.