首页>
外国专利>
CORPUS SELECTION DEVICE, CORPUS SELECTION METHOD, AND PROGRAM
CORPUS SELECTION DEVICE, CORPUS SELECTION METHOD, AND PROGRAM
展开▼
机译:语料库选择设备,语料库选择方法和程序
展开▼
页面导航
摘要
著录项
相似文献
摘要
PROBLEM TO BE SOLVED: To provide a corpus selection device, a corpus selection method, and a program which select a learning corpus capable of achieving both the improvement in quality of a language model and the reduction in capacity for use of a storage area.;SOLUTION: A corpus selection device AA divides a learning corpus (whole) into learning corpuses (subset 1 to subset 3), and subset language models 1 to 3 corresponding to the learning corpuses (subsets 1 to 3) respectively are generated by language modeling. With respect to respective subset language models 1 to 3, perplexities are calculated using a task representation corpus to obtain perplexity-1 to perplexity-Y. Learning corpuses corresponding to subset language model having lower perplexities are removed from the learning corpus(whole) to select a learning corpus (selected).;COPYRIGHT: (C)2012,JPO&INPIT
展开▼