Integrating Syntax, Semantics,and Discourse DARPA (Defense Advanced Research Projects Agency) Natural Language Understanding Program

摘要

A workshop on evaluation on natural language processing systems was held at the Wayne Hotel in Wayne, Philadelphia, Dec 8,9. The workshop discussed evaluation methods used in other disciplines and examples of attempts to evaluate natural language processing systems. The participants then broke up into working groups to discuss how to apply those methods to particular areas in natural language processing. The working groups came up with specific proposals for evaluation methods and for additional workshops focused on specific applications. There was a panel discussion on the need for a large corpus of both written and spoken language that could be used for training sets and test sets for specific applications. (kr)