Logo: Deutsches Institut für Internationale Pädagogische Forschung

Publications

Publikationendatenbank

show results

Autor:
Engelhardt, Lena; Naumann, Johannes; Goldhammer, Frank; Frey, Andreas; Wenzel, S. Franziska C.; Hartig, Katja; Horz, Holger:

Titel:
Convergent evidence for validity of a performance-based ICT skills test

Quelle:
In: European Journal of Psychological Assessment., 36 (2020) 2 , 269-279

URL des Volltextes:
https://econtent.hogrefe.com/doi/10.1027/1015-5759/a000507

Sprache:
Englisch

Dokumenttyp:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)

Schlagwörter:
Informationstechnologische Bildung, Informations- und Kommunikationstechnologie, Problemlösen, Kompetenz, Fertigkeit, Schüler, Sekundarstufe I, Test, Testaufgabe, Validität, Evidenz, Deutschland


Abstract(englisch):
The goal of this study was to investigate sources of evidence of convergent validity supporting the construct interpretation of scores on a simulation-based ICT skills test. The construct definition understands ICT skills as reliant on ICT-specific knowledge as well as comprehension and problem-solving skills. On the basis of this, a validity argument comprising three claims was formulated and tested. (1) In line with the classical nomothetic span approach, all three predictor variables explained task success positively across all ICT skills items. As ICT tasks can vary in the extent to which they require construct-related knowledge and skills and in the way related items are designed and implemented, the effects of construct-related predictor variables were expected to vary across items. (2) A task-based analysis approach revealed that the item-level effects of the three predictor variables were in line with the targeted construct interpretation for most items. (3) Finally, item characteristics could significantly explain the random effect of problem-solving skills, but not comprehension skills. Taken together, the obtained results generally support the validity of the construct interpretation.


DIPF-Abteilung:
Bildungsqualität und Evaluation

Notizen:

last modified Nov 11, 2016