Comparison of Dichotic Listening Task Scoring Methods

摘要

In a recent evaluation of two dichotic listening tasks (DLTs) as predictors of performance in Naval Aviation Undergraduate Pilot Training, results based on one of five scoring methods were presented. The purpose of this report is to provide DLT performance scores using all five scoring methods for comparative purposes to determine the scoring system most economical and efficient for automated scoring and, most sensitive to individual and mean differences. Five scoring methods are described which vary primarily in their treatments of errors, and in their consideration of the importance of sequence effects. Five independent analyses of previously reported data were performed. Results were nearly invariant across all five methods; i.e., intercorrelations among scores across scoring techniques exceeded 0.90. Two of the scoring methods are recommended for purposes of standardizing future analyses of DLT performance, one because of its simplicity and ease of application and the other, because it may have greater sensitivity to differences in individual performance.