DIPF database of publications

Detailansicht Treffer

DIPF database of publications

Show results

Kunina-Habenicht, Olga; Rupp, André A.; Wilhelm, Oliver:

Incremental validity of multidimensional proficiency scores from diagnostic classification models: An illustration for elementary school mathematics

In: International Journal of Testing, 17 (2017) 4 , 277-301


Document type
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)

Arithmetik, Diagnostik, Empirische Untersuchung, Item-Response-Theory, Leistungsmessung, Mathematische Kompetenz, Modell, Regressionsanalyse, Reliabilität, Schülerleistung, Schülerleistungstest, Schuljahr 04, Testkonstruktion, Validität

Diagnostic classification models (DCMs) hold great potential for applications in summative and formative assessment by providing discrete multivariate proficiency scores that yield statistically-driven classifications of students. Using data from a newly developed diagnostic arithmetic assessment that was administered to 2,032 fourth-grade students in Germany, we evaluated whether the multidimensional proficiency scores from the best-fitting DCM have an added value, over and above the unidimensional proficiency score from a simpler unidimensional IRT model, in explaning variance in external (a) school grades in mathematics and (b) unidimensional proficiency scores from a standards-based large-scale assessment of mathematics. Results revealed high classification reliabilities as well as interpretable parameter estimates for items and students for the best-fitting DCM. However, while DCM scores were moderatly correlated with both external criteria, only a negligible incremental validity of the multivariate attribute scores was found. (DIPF/Orig.)

Educational Quality and Evaluation