Using deep belief networks to extract Chinese entity attribute relation in domain-specific

摘要

The state-of-the-art methods used for entity attribute relation extraction are primarily based on statistical machine learning, and the performance strongly depends on the quality of the extracted features. Deep belief networks (DBN) has been successful in the high dimensional feature space information extraction task, which can without complicated pre-processing. In this paper, the DBN, which consists of one or more restricted Boltzmann machine (RBM) layers and a back-propagation (BP) layer, is presented to extract Chinese entity attribute relation in domain-specific. First, the word tokens are transformed to vectors by looking up word embeddings. Then, the RBM layers maintain as much information as possible when feature vectors are transferred to next layer. Finally, the BP layer is trained to classify the features generated by the last RBM layer, and adopting Levenberg-Marquard (LM) optimisation algorithm to do the training. The experimental results show that the proposed method outperforms state-of-the-art learning models in specific domain entity attribute relation extraction.