PRODUCING TRAINING SETS FOR MACHINE LEARNING METHODS BY PERFORMING DEEP SEMANTIC ANALYSIS OF NATURAL LANGUAGE TEXTS

摘要

Systems and methods for producing training sets for machine learning methods by performing deep semantic analysis of natural language texts. An example method comprises: performing a lexico-morphological analysis of a natural language text comprising a plurality of tokens, to determine one or more lexical and grammatical attributes associated with each token of the plurality of tokens, each token comprising at least one natural language word; performing a syntactico-semantic analysis of the natural language text to produce a plurality of syntactico-semantic structures representing the natural language text; determining, using the syntactico-semantic structures, a plurality of syntactic and semantic attributes associated with the natural language text; selecting, among the lexical, grammatical, syntactic and semantic attributes, a set of output attributes; and producing an output text comprising symbolic identifiers of one or more attributes of the output set of attributes, wherein each attribute is associated with a corresponding part of the natural language text.