Marmoset: A programming project assignment framework to improve the feedback cycle for students, faculty and researchers.

摘要

We developed Marmoset, a system that improves the feedback cycle on programming assignments for students, faculty and researchers alike.;Using automation, Marmoset substantially lowers the burden on faculty for grading programming assignments, allowing faculty to give students more rapid feedback on their assignments.;To further improve the feedback cycle, Marmoset provides students with limited access to the results of the instructor's private test cases before the submission deadline using a novel token-based incentive system. This both encourages students to start their work early and to think critically about their work. Because students submit early, instructors can monitor all students' progress on test cases and identify where in projects students are having problems in order to update the project requirements in a timely fashion and make the best use of time in lectures, discussion sections, and office hours.;To study in more detail the development process of students, Marmoset can be configured to transparently capture snapshots to a central repository every-time students save their files. These detailed development histories offer a unique, detailed perspective of each student's progress on a programming assignment, from the first line of code written and saved all the way through the final edit before the final submission. This type of data has proved extremely valuable for many uses, such as mining new bug patterns and evaluating existing bug-finding tools.