Work-in-Progress: Syntactic Code Similarity Detection in Strongly Directed Assessments

摘要

When checking student programs for plagiarism and collusion, many similarity detectors aim to capture semantic similarity. However, they are not particularly effective for strongly directed assessments, in which the student programs are expected to be semantically similar. A detector focusing on syntactic similarity might be useful, and this paper reports its effectiveness on programming assessment tasks collected from algorithms and data structures courses in one academic semester. Our study shows that syntactic similarity detection is more effective than its semantic counterpart in strongly directed assessments, with some irregular similarity patterns being useful for raising suspicion. We also tested whether take-home assessments have higher similarity than in-class assessments, and confirmed that hypothesis. Consistency of the findings will be further validated on other courses with strongly directed assessments, and a syntactic similarity detector specifically tailored for strongly directed assessments will be proposed.