Language model compression device, language model access device, language model compression method, language model access method, language model compression program, language model access program

摘要

PPROBLEM TO BE SOLVED: To provide technology of efficiently accessing a language model by suppressing the amount of data of an n-gram language model as a learning result. PSOLUTION: The language model compression device 1 stores the n-gram language model in a language model storage section 5. A data structure conversion section 3 converts a pointer for indicating a first position of an (n+1)-gram in a data arrangement of the n-gram language model stored in the language model storage section 5, to fixed byte expression, and stores it in a conversion data storage section 6. A compression section 4 of pointer expression makes a virtual trie structure by providing a virtual route node in a tree structure of the n-gram language model stored in a conversion data storage section 6, and the pointer is compressed and converted to a level-order unary degree sequence (LOUDS) expression. The compressed and converted data is stored in a compression data storage section 7. A storage device (RAM) of a computer is mainly used for the storage section 7. PCOPYRIGHT: (C)2011,JPO&INPIT