Automatic Emotion Detection as a Teaching Aid in Online Knowledge Assessment

摘要

In this paper, we present an initial study of possibilities of applying Artificial Intelligence (AI) and computer vision-based approaches aimed to improve and alleviate the process of conducting knowledge assessment over the Microsoft Teams platform. We did that by developing a deep-neural-network-based system which is able to locate faces and predict emotions based on students’ facial expressions. The system was evaluated on videos recorded during an online assessment of the ability of students to train and deploy deep learning solutions using Python and TensorFlow. We present results of this evaluation and show that, although the accuracy of our algorithm is limited at frame level, as we optimized for computational performance, it provides sufficient information to identify key changes on students’ behavior, which should be brought to the teachers’ attention.