Developing Classification Criteria for Programming Tasks

摘要

The Online Judge is an on-line programming trainer created by University of Valladolid in 1995 with the aim of training users who participate in programming competitions. Currently this tool has over 64,000 users from many countries and more than 2,000 tasks.rnIn 2007 the project "Integrating On-line Judge into effective e-learning", funded by the European Commission under the Life Long Learning Programme (grant number 13 5221-LLP-1-2007-1-ES-KA3-KA3MP), was launched in order to satisfy the users' demand for greater pedagogic character and to facilitate the use of the Online Judge in courses of informatics in higher and secondary education.rnThe Online Judge has been maintaining a task database, which can be very useful for teaching algorithms at various levels. However it is not easy for teachers to find proper tasks which fit particular students. At the moment it is possible to weight task difficulty by the percentage of participants who provide correct solutions. It is impossible to find which topics or algorithms are required to solve tasks.rnAn attempt to classify the existing tasks by possible solution algorithms was started by the Online Judge members, using a Wiki. However the process is ad hoc and needs systematic revision and analysis.rnWe are providing several schemas for classification of the tasks:rn(1) Categories proposed by task authors, e.g. by providing comments on the best solution.rn(2) Categories proposed by the Online Judge administrators, e.g. length of source code or time required for solving the task. This type of classification can only be done by the administrators as other users do not have any access to the solutions and statistical data.rn(3) Categories proposed by participants ranking the difficulty of solved tasks.rn(4) Categories proposed by teachers who have used the tasks for several years in their courses, e.g. task topics and difficultyrnTo make an easier classification process we propose to develop a set of keywords or key phrases. Applying these key phrases to each task will provide more information to users.