Incorporating an Automatic Judge into Blended Learning Programming Activities

摘要

This paper presents the results of our efforts to incorporate automated judging into the evaluation of programming assignments by students. Our experimentation on automated evaluation of programming assignments was twofold: at first, we have used the stand alone open source system Mooshak independently from the learning management system supporting the rest of e-learning activities; then, we have isolated and integrated its automatic judge engine into the learning management system Claroline. In both cases, automated judging has been used in conjunction with marking by instructors offering regular and frequent feedback. An online questionnaire was presented to the students to quantify their preferences in using the automatic judge with respect to pedagogical results. The data we gathered provides a clear indication that students think positively of the automatic judge when used for evaluation of programming assignments and in conjunction with their instructors' feedback and marking.