Keyword Extraction from Stemming and Sense Information by Neural Networks

摘要

The research presented in this paper investigates domain independent techniques for automatic knowledge extraction from text. The knowledge is to be organised into a knowledge base. The techniques presented are aimed at the first stage: the automatic identification of keywords. Artificial Neural Networks (ANNs) are trained to recognise keywords on the basis of their sense information, stemming analysis and relationships to one or more seed words which are manually selected as indicative of the areas of knowledge required. The relationships are obtained from an electronic dictionary. Training data is generated using example keywords that humans have identified as being keywords associated with particular seed words. After training, the ANN can be used to extract keywords automatically from other documents. New measures, natural generalisation and pure generalisation, based on the concept of generalisation have been introduced. Recall and precision measures commonly used in knowledge extraction research have been adapted to suit the ANN-based approach. Experiments so far, on documents concerning education, show the encouraging result of this new approach.