NATURAL LANGUAGE PROCESSING SYSTEM AND METHOD FOR WORD REPRESENTATIONS IN NATURAL LANGUAGE PROCESSING

摘要

The present invention relates to a natural language processing system and a word expression method in natural language processing, in a word expression method in natural language processing performed by a natural language processing system, a) a vocabulary including at least one word and each word providing a vocabulary dictionary dataset including previously learned word embedding information; b) When a vocabulary based on the vocabulary dictionary dataset is provided as input data, subword information about words existing in the input data is extracted using a word expression model, and the subword information is embedded in words calculating a vector; and c) matching the calculated word embedding vector with the pre-learned word embedding information of the corresponding word, replacing the pre-learned word embedding information with the calculated word embedding vector to learn a word expression for the word. wherein the word expression model includes a convolutional neural network-based convolutional neural network that calculates lower-order word feature vectors using the lower-order word information, and the lower-order word feature vectors calculated by the convolution module. It includes a highway network-based highway module that adaptively combines to calculate a word embedding vector of a corresponding word.