Test-Driving TANKA: Evaluating a Semi-Automatic Ssytem of text Analysis for Knowledge Acquisition

摘要

The evaluation of a large implemented natural language processing system involves more than its application to a common performance task. Such tasks have been used in the message understanding conferences (MUCs), text retrieval conferences (TRECs) aswell as in speech technology and machine translation workshops. It is useful to compare the performance of different systems in a predefiend application, but a detailed evaluation must take into account the specificity of the system.