Extracting Chinese Frequent Strings Without a Dictionary From a Chinese Corpus and its Applications

摘要

This paper describes how to extract Chinese frequent strings without using a dic- tionary. In this paper, we generalize the notations of words and unknown words to those of frequent strings. The Chinese frequent strings (CFSs) we define include words, unknown words, and other strings that are frequently used. Some examples of CFSs are "(can only let)", "(every minute and every second)", " (bearing in mind the interest of each other)", and "(and nobody)". A CFS is very useful in Chinese natural language processing and its related applications.