首页> 外国专利> FINE-TUNING METHOD AND APPARATUS FOR EXTERNAL KNOWLEDGE-FUSING BERT MODEL, AND COMPUTER DEVICE

FINE-TUNING METHOD AND APPARATUS FOR EXTERNAL KNOWLEDGE-FUSING BERT MODEL, AND COMPUTER DEVICE

机译:用于外部知识融合BERT模型和计算机设备的微调方法和装置

摘要

A fine-tuning method and apparatus for an external knowledge-fusing BERT model, and a computer device. The method comprises: upon receiving an inputted Chinese sentence, obtaining a sentence vector and part-of-speech vectors of the Chinese sentence according to a BERT model (S110); extracting from a preset external knowledge base a sememe set of the Chinese sentence (S120); inputting sememes of the sememe set into the BERT model to obtain a sememe vector set of the sememe set (S130); filtering out of the sememe vector set the sememe vectors of the Chinese sentence (S140); and, on the basis of a preset fusion rule, fusing the sentence vector, the part-of-speech vectors, and the sememe vectors of the Chinese sentence so as to fine-tune the BERT model (S150). The method is based on natural language processing technology in artificial intelligence. In the invention, external knowledge is fused into a BERT model so as to fine-tune said model, thereby increasing the text analysis accuracy of the BERT model, with said external knowledge further allowing for the expanded text analysis capability of the BERT model.
机译:用于外部知识融合BERT模型和计算机设备的微调方法和装置。该方法包括:根据BERT模型,接收到输入的汉语句,获得句子向量和汉语句的词组矢量(S110);从预设的外部知识基础提取汉语句子的Semime集(S120);将Sememe的Sememes设置为BERT模型,以获得Semime集的Semime向量组(S130);过滤出Sememe向量设置中文句子的Semime Vectors(S140);并且,在预设的融合规则的基础上,融合句子向量,汉语句子的术语向量和Sememe向量,以便微调BERT模型(S150)。该方法基于人工智能自然语言处理技术。在本发明中,外部知识被融合到BERT模型中,以便微调所述模型,从而增加了BERT模型的文本分析精度,所述外部知识进一步允许伯特模型的扩展文本分析能力。

著录项

相似文献

  • 专利
  • 外文文献
  • 中文文献
获取专利

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号