DIPF database of publications

Detailansicht Treffer

DIPF database of publications

Show results

Marksteiner, Tamara; Kuger, Susanne; Klieme, Eckhard:

The potential of anchoring vignettes to increase intercultural comparability of non-cognitive factors

In: Assessment in Education, 26 (2019) 4 , 516-536

URL of full text:


Document type
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)

We investigate whether Anchoring Vignettes (AV) improve intercultural comparability of non-cognitive student-directed factors (e.g., procrastination). So far, correlation analyses for anchored and non-anchored scores with a criterion have been used to demonstrate the effectiveness of AV in improving data quality. However, correlation analyses are often used to investigate external validity of a scale. Nonetheless, before testing for validity, the reliability of the measurement of a construct should be examined. In the present study, we tested for measurement invariance across countries and languages and compared anchored and non-anchored student-directed self-reports that are highly relevant for the students' self and their behaviour and performance. In addition, we apply further criteria for testing reliability. The results indicate that the data quality for some of the constructs can - in fact - be improved slightly by anchoring; whereas, for other self-reports, anchoring is less successful than was hoped. We discuss with regard to possible consequences for research methodology. (DIPF/Orig.)

Educational Quality and Evaluation