MapReduce architecture-based Chinese word segmentation research

摘要

Chinese word segmentation is the foundation of Chinese information processing. The speed Chinese word segmentation is the bottleneck of a variety of Chinese information processing applications. Cloud computing can improve the speed of Chinese Word Segmentation processing, but how to achieve Chinese word segmentation in the cloud computing environment is a new field of Chinese information processing issues. In this paper, the MapReduce programming ideas are applied to Chinese Word Segmentation processing in hadoop platform. It can improve Chinese Word Segmentation processing speed effectively on the basis of ensuring the accuracy of word segmentation.