【24h】

Neural Chinese Word Segmentation with Dictionary Knowledge

机译:具有字典知识的神经汉语分词

获取原文

摘要

Chinese word segmentation (CWS) is an important task for Chinese NLP. Recently, many neural network based methods have been proposed for CWS. However, these methods require a large number of labeled sentences for model training, and usually cannot utilize the useful information in Chinese dictionary. In this paper, we propose two methods to exploit the dictionary information for CWS. The first one is based on pseudo labeled data generation, and the second one is based on multi-task learning. The experimental results on two benchmark datasets validate that our approach can effectively improve the performance of Chinese word segmentation, especially when training data is insufficient.
机译:中文分词(CWS)是中文NLP的一项重要任务。近来,已经提出了许多基于神经网络的方法用于CWS。然而,这些方法需要大量的带标签的句子来进行模型训练,并且通常不能利用汉语词典中的有用信息。在本文中,我们提出了两种方法来利用CWS的字典信息。第一个基于伪标记数据生成,第二个基于多任务学习。在两个基准数据集上的实验结果证明,我们的方法可以有效地提高中文分词的性能,尤其是在训练数据不足的情况下。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号