EXTRACTION OF TOKENS AND RELATIONSHIP BETWEEN TOKENS TO FORM AN ENTITY RELATIONSHIP MAP

摘要

A system and method of creating an entity relationship map includes receiving a stream of lexical matter associated with one or more categories (302) and identifying one or more tokens from the received lexical matter based on the one or more categories (304). A frequency of one or more of unique lexical token and recurring lexical token are determined (306) and one or more outliers based on a standard deviation range associated with the at least one category is eliminated (308). Sentences with the one or more recurring lexical tokens are selected (310) to find one or more lexical neighbors and the entity relationship map is created based on an association between the unique lexical tokens and the at least one lexical neighbor (312).