Construct Maps: A Tool to Organize Validity Evidence

摘要

In his article, Wyse (this issue) introduces a new tool for collecting judgments from and providing information to standard-setting panelists. Wyse expands the traditional notion of construct maps to include information typically presented to standard-setting panelists, including item difficulties or the percentage of students scoring above a given cut-score. He argues that when panelists see such detailed information, they can make more internally consistent judgments. Moreover, panelists' judgments will not be restricted by artifacts of the standard-setting method (e.g., limited pages in an ordered item booklet).