An Ambiguity Discovery Algorithm on Chinese Word Segmentation Based Dictionary

摘要

Chinese word segmentation is a basic research issue on Chinese information processing tasks such as information extraction; information retrieval; machine translation; text classification; automatic text summarization; speech recognition, natural language understanding and So on. And the ambiguity problem is one of the most difficult problems in Chinese word segmentation .The paper introduced several normal ambiguity discovery algorithm, and proposed a new method of ambiguity discovery that can discover many crossing ambiguity fields and covering ambiguity fields at the same time.