Review of and Recommendations for Procedures Used to Evaluate the ExternalEffectiveness of Intelligent Tutoring Systems

摘要

This report reviews and discusses intelligent tutoring system (ITS) evaluation standards and procedures. Three criteria evolved from the review and are proposed to accurately evaluate ITS product effectiveness. First, the instructional effectiveness of ITS applications, human tutors, and traditional methods needs to be compared using performance data. Second, extensive ITS applications should be used to evaluate instruction effectiveness. Third, large groups of subjects must be used for the evaluations to precisely estimate ITS effectiveness.