Automated generation of test cases for analyzing natural-language-interface-to-database systems

摘要

Methods, systems, and computer program products for automated generation of test cases for analyzing natural-language-interface-to-database systems are provided herein. A computer-implemented method includes identifying sources of ambiguity from input to a natural-language-interface-to-database system and a precondition corresponding to each of the identified sources of ambiguity; generating test cases which analyze capabilities of the natural-language-interface-to-database system, wherein generating the one or more test cases includes determining validity of the preconditions within the context of the capabilities of the natural-language-interface-to-database system; automatically generating an ontology-dependent structured query template based at least in part on the generated test cases; automatically generating natural language queries based at least in part on the ontology-dependent structured query template; and outputting, to at least one user, the ontology-dependent structured query template and the natural language queries.