Multivocal Challenge Toward Measuring Computational Thinking--Bebras Challenge Versus Computer Programming

摘要

Towards the establishment of an evaluation platform for computational thinking (CT), in this paper, we use the "Bebras Challenge" coined by Dr. Dagiene as a measurement tool of CT skills. This paper presents a "triangle examination" which includes three kinds of testing methods (programming testing, traditional paper testing, and Bebras Challenges). Approximately one hundred and fifty non-computer science (CS) undergraduate students participated in the examination as a part of an introductory programming course. The result indicated a weak but positive correlation (.38-.45) between the three methods. Additional qualitative analysis for each task in Bebras showed that requirements of algorithm creation and interpretation, and explicitness of the description, are two critical factors to determine a high correlation between other testing methods. We conclude our research by showing a clear correlation between the Bebras Challenge and actual programming.