Evaluating expert systems using a multiple-criteria,multiple-stakeholder approach

摘要

Test results of an approach to evaluating the quality of expertnsystems are presented. The solution proposed is a multiple-criteria- andnmultiple-stakeholder-based subjective assessment technique. Its validitynwas established by conducting field tests with operational expertnsystems at 19 sites in the North American insurance industry. Thenresults indicate that such a socio-technical approach to evaluatingnexpert systems is a promising alternative to current ad hoc andnanecdotal practices. It is the long-term goal of such a line ofninvestigation to produce a diagnostic tool that would serve to supportnfeedback in the knowledge engineering life cycle