MULTI-THREAD COMPRESSION AND DECOMPRESSION METHODS IN GENERIC DATA GZ FORMAT, AND DEVICE

摘要

Multi-thread compression and decompression methods in generic data gz format, applicable to the field of data processing technology. The step of compression is as follows (S1): inputting original data, and performing block division processing on the original data, to obtain M data blocks (S11); using N1 threads in a preset first thread pool to compress said M data blocks, and during compression, reserving a preset space in a file header portion in a gz format, to obtain M copies of compressed data gzDi and the sizes of the data gzDi (S12); writing said M copies of compressed data gzDi into a disk in sequence, and writing the corresponding sizes of the M copies of data gzDi into the preset space in sequence, to obtain compressed data (S13). The step of decompression is as follows (S2): inputting the compressed data, reading the list information of the written sizes, and dividing the compressed data according to the list information of the sizes, to obtain M data blocks gzDi (S21); using N2 threads in a preset second thread pool to decompress said M data blocks gzDi, to obtain M copies of decompressed original data Di (S22); and connecting the decompressed original data Di in series according to the list information of the sizes to obtain complete original data (S23). The present method achieves the purpose of multi-thread compression and multi-thread decompression.