Effect of Sorting Procedure on Ranking Error

摘要

Ranking is often used to provide criterion measures, although the effect of varied sorting procedures on ranking accuracy is unknown. This study investigates the efficiency of four sorting methods varying in degree of structure. Efficiency was defined in terms of the absolute difference between the judged rank order of a series of 50 irregularly shaped figures graduated by size, and the rank order of these figures based on their physical measurement. Analysis of these errors revealed that the procedure with the greatest restriction of freedom was significantly more inefficient than three less restrictive procedures. With simple stimuli, there appears to be an optimal degree of structure, beyond which ranking efficiency decreases. Comparison of present with previous evidence suggests efficiency of sorting procedure may vary as a function of task complexity. (Author)