A DEMOCRATIC PROCESS OF TESTING FOR COGNITIVELY DEMANDING SKILLS AND EXPERIENCES

摘要

A system and methods for grading a candidate based on evaluations by assessors. The assessors evaluate questions that the candidate authors, and answers that the candidate prepares (510). Each assessor provides a question score, or answer score (530), as an objective measure of the evaluation. The methods retrieve a grade for each assessor (535), and calculate a grade for the candidate (540) based on the question score, or answer score, and the grade for each assessor. The methods grade each assessor based on evaluations by other assessors (550). The other assessors evaluate the question score, or answer score, and provide an evaluation score (555) as an objective measure of the evaluation. The methods retrieve a grade for each other assessor (560), and calculate a grade for the assessor based on the evaluation score, and the grade for each other assessor (565).