An evaluation of automated writing assessment

摘要

This paper describes research done to empiri- cally study the efficacy of using Criterion, a commercial web-based writing evaluation platform, as a revision aid, especially within a class following the Process Writing pedagogy. This paper first describes the background and rationale for Criterion automated writing evaluation, the Process Writing approach, as well as the natural language processing tech- niques used by Criterion. In this study an essay was submitted to Criterion multiple times with variations in a single feature each time. By log- ging the results and comparing how Criterion scored each submission it is possible to deter- mine what components of an essay influence Criterion's scoring. The conclusions from these results suggest that Criterion alone is not an adequate revision aid for the developing writer.