Evaluation Methods for Complex Intelligent Information Systems (EMCIIS)

摘要

The objective of the EMCIIS effort was to perform research and development studies and experiments to demonstrate improvements in methods for evaluating the behavior and performance of Complex Intelligent Information Systems (CIIS). The critical goals achieved during the life of this effort included the following: (1) Make evaluation methods and tools accessible to CIIS researchers and developers through an Evaluation of Information Systems (EIS) on-line web site. The hypertext accessible methods were developed using Hypertext Markup Language (HTML) and were made available through the World Wide Web (WWW). (2) Develop a Hypertext CIIS Evaluation Field Guide. The hypertext Field Guide provided tools for the evaluation of information systems and was made available through the WWW. In addition, the effectiveness of the Field Guide as an aid to CIIS researchers, developers, and evaluators was assessed. (3) Advance the state of evaluation methods and research in support of CIIS incorporation into C4I and other systems. The primary product is the EIS WWW site which provides a centralized location for AI researchers seeking information on and assistance with, AIL systems evaluation. Development of the site and its on-line tools was carried out by Sterling Software, the University of Massachusetts (UMASS), and Colorado State University (CSU).