Rate-all-that-apply (RATA) with semi-trained assessors: An investigation of the method reproducibility at assessor-, attribute- and panel-level

摘要

Rate-all-that-apply (RATA) is a variant of check-all-that-apply (CATA) questions that allows assessor to rate the intensity of selected attributes. Compared to CATA, RATA has the potential to improve sample description and discrimination, and might be more useful when only a small number of assessors are available. Before advocating its use with confidence, investigations on the method validity and reproducibility are necessary.