Establishing a Proficiency Baseline for any Domain Specific Natural Language Processing

摘要

A system, method, and computer-readable medium for performing a domain specific evaluation operation comprising: storing domain specific data within a business query repository; determining and understanding variations within language for a domain specific category; performing a test planner operation on an identified NLP system, the test planner operation allowing a user to select a test plan to apply to the identified NLP system; and, evaluating the identified NLP system using a text planner output.