Insufficient effort responding (IER) affects many forms of assessment in botheducational and psychological contexts. Much research has examined differenttypes of IER, IER’s impact on the psychometric properties of test scores, andpreprocessing procedures used to detect IER. However, there is a gap in theliterature in terms of practical advice for applied researchers andpsychometricians when evaluating multiple sources of IER evidence, including thebest strategy or combination of strategies when preprocessing data. In thisstudy, we demonstrate how the use of different IER detection methods may affectpsychometric properties such as predictive validity and reliability. Moreover,we evaluate how different data cleansing procedures can detect different typesof IER. We provide evidence via simulation studies and applied analysis usingthe ACT’s Engage assessment as a motivating example. Based on the findings ofthe study, we provide recommendations and future research directions for thosewho suspect their data may contain responses reflecting careless, random, orbiased responding.
展开▼
