SYSTEM, METHOD AND COMPUTER PROGRAM PRODUCT FOR ASSESSING THE CAPABILITIES OF A CONVERSATION AGENT VIA BLACK BOX TESTING

摘要

A conversational agent capability assessment method, system, and computer program product, includes assessing a performance, a personality and a cognitive trait of a conversational agent based on natural written language by a second conversational agent by combining an analysis of a plurality of metrics that each compare a metric from the conversational agent with a metric from the second conversational agent and producing a report detailing the performance, the personality, and the cognitive trait of the conversational agent