EFFICIENT RETRIEVAL OF DATA THAT HAS BEEN LOSSLESSLY REDUCED USING A PRIME DATA SIEVE

摘要

Techniques and systems for reconstituting a sequence of losslessly reduced data chunks are described. Some embodiments can collect metadata while losslessly reducing a sequence of data chunks by using prime data elements to obtain the sequence of losslessly reduced data chunks, wherein the metadata includes an indicator corresponding to each prime data element that indicates whether or not the prime data element is referenced in multiple losslessly reduced data chunks, and optionally includes a memory size of each prime data element. Some embodiments can retrieve the metadata and reconstitute the sequence of losslessly reduced data chunks, wherein during reconstitution, the metadata can be used to retain only those prime data elements in memory that are referenced in multiple losslessly reduced data chunks. Some embodiments can, prior to performing reconstitution, use the metadata to optionally allocate sufficient memory to store the prime data elements that are referenced in multiple losslessly reduced data chunks.