Diagnostic Evaluation of MOOCs Based on Learner Reviews: The Analytic Hierarchy Process (AHP) Approach

摘要

The evaluation of MOOCs (massive open online courses) is needed to improve their design quality and to inform learners regarding course selection. In this paper, we proposed and validated an Analytic Hierarchy Process (AHP) Approach based on standardized rubric, expert feedback, data mining and emotion detection to systematically and diagnostically evaluate the quality of MOOCs. Using this approach, we analyzed review comments of three popular MOOCs on the Coursera Platform. The results indicate that the AHP approach is a feasible MOOC evaluation method that can provide accurate ratings as well as in-depth analysis of course design and learning outcomes. It is concluded that this new approach can supplement the existing user rating system with automated formative and summative evaluations.