TECHNOLOGIES FOR VALID DEPENDENCY PARSING IN CASUAL TEXT

摘要

Technologies for natural language processing include a computing device that loads natural language text data that includes multiple words, such as a naturally elicited response or comment data. The computing device applies a constituency parser to the natural language text data to generate a constituency parse tree. The constituency parse tree may include multiple nodes that each correspond to a hierarchical constituent of the natural language text. The computing device applies a constituency rule to identify clauses in the natural language text data. The constituency rule may identify a left-most daughter of each subordinate clause node of the constituency parse tree. Each subordinate clause is distinct, preventing dependencies from crossing clause boundaries. The computing device applies a dependency parser to each clause to generate a corresponding dependency parse. Each dependency parse may include a graph with nodes corresponding to words of the clause and edges corresponding to dependency relationships.