Confronting Subjective Criteria in the Evaluation of Computer-Based Critiquing Advice

摘要

There is a need for formal evaluation in the development of any computer-based expert systems. This may be quite difficult when judging a critiquing system, that is, a system which responds to a proposed management strategy with an explanatory prose discussion of the advisability of that approach. DxCON is an expert system which produces prose critiques discussing the radiologic workup of obstructive jaundice. This paper briefly describes DxCON, and then focuses on a study performed to validate its knowledge. The need to confront subjective as well as objective criteria in the evaluation of expert critiquing systems is explored.