Search and compression of large amount of text files with two stage compression method

摘要

In this paper we discuss search and compression of large amount of text files with two stage compression method. The texts are usually stored in secondary storage, and they are frequently compressed for file size saving. When we search compressed text files, it is usually necessary to decode them before search. Therefore, search is time consuming. On the other hand, we can use indexing for fast search. But indices consume extra amount of secondary storage. We proposed a two-stage compression method to improve the performance. It compresses text files using index files and romp cases the result again with another algorithm. This paper discusses application of the two-stage compression method for large amount of text files such as newspaper and magazine data, arid proposes an improved method.