Evaluating the Effect of Uncertainty Visualisation in Open Learner Models on Students' Metacognitive Skills

摘要

Self-assessment is widely used in open learner models (OLMs) as a metacognitive process to enhance students' self-regulated learning. Yet little research has investigated the impact of the visualisation when the OLM shows the conflict (i.e., uncertainty) between the system's beliefs about student knowledge and students' confidence in the correctness of their answers. We deployed such an OLM and studied its use. The impact of the uncertainty visualisation on student learning, confidence gains and actions was determined by comparing these measures across two treatment conditions and a control condition. Those who accessed the OLM performed significantly better on the post-test, and those in the treatment group who could see both sets of beliefs separately showed greater confidence gains and used the system more.