DIPF database of publications

Author
Kunina-Habenicht, Olga; Rupp, André A.; Wilhelm, Oliver:

Title:
Incremental validity of multidimensional proficiency scores from diagnostic classification models: An illustration for elementary school mathematics

Source:
In: International Journal of Testing, 17 (2017) 4 , 277-301

Language:
Englisch

Document type
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)

Schlagwörter:
Arithmetik, Diagnostik, Empirische Untersuchung, Item-Response-Theory, Leistungsmessung, Mathematische Kompetenz, Modell, Regressionsanalyse, Reliabilität, Schülerleistung, Schülerleistungstest, Schuljahr 04, Testkonstruktion, Validität

Abstract(englisch):
Diagnostic classification models (DCMs) hold great potential for applications in summative and formative assessment by providing discrete multivariate proficiency scores that yield statistically-driven classifications of students. Using data from a newly developed diagnostic arithmetic assessment that was administered to 2,032 fourth-grade students in Germany, we evaluated whether the multidimensional proficiency scores from the best-fitting DCM have an added value, over and above the unidimensional proficiency score from a simpler unidimensional IRT model, in explaning variance in external (a) school grades in mathematics and (b) unidimensional proficiency scores from a standards-based large-scale assessment of mathematics. Results revealed high classification reliabilities as well as interpretable parameter estimates for items and students for the best-fitting DCM. However, while DCM scores were moderatly correlated with both external criteria, only a negligible incremental validity of the multivariate attribute scores was found. (DIPF/Orig.)

DIPF-Departments:
Educational Quality and Evaluation

Notes: