Effects of anchoring vignettes on the validity of student self-assessment

Abstract

Anchoring vignettes (King, Murray, Salomon, & Tandon, 2004) are item batteries designed for correcting rating data differences in subjective self-report survey data. In the present study, we investigated how reporting heterogeneity may bias rating data and how such bias can be adjusted by using the anchoring vignettes approach. Employing empirical data of a student self-assessment measuring intercultural competence, anchoring vignettes were developed representing various levels of intercultural competence. Analyses were performed to evaluate the effects of the anchoring vignette approach on the validity of the student self-assessment. Results suggest that vignettebased adjustments appear to be effective. Promises and limitations of the anchoring vignettes approach in the studied context will be discussed in the presentation.