Logo: Deutsches Institut für Internationale Pädagogische Forschung

DIPFdocs Open Access

Treffer anzeigen

Autor:
Goldhammer, Frank; Zehner, Fabian:

Titel:
What to make of and how to interpret process data

Quelle:
In: Measurement: Interdisciplinary Research and Perspectives, 15 (2017) 3/4 , 128-132

URL des Volltextes:
http://www.dipfdocs.de/volltexte/2020/19208/pdf/Measurement_2017_3-4_Goldhammer_Zehner_What_to_make_of_and_how_to_interpret_process_data_A.pdf

URN:
urn:nbn:de:0111-dipfdocs-192082

Sprache:
Englisch

Dokumenttyp:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)

Schlagwörter:
Technologiebasiertes Testen, Kognitive Kompetenz, Testdurchführung, Kognitive Prozesse, Datenanalyse, Indikator, Interpretation, Validität


Abstract(englisch):
Maddox (2017) argues that respondents' talk and gesture during an assessment inform researchers how a response product has evolved. Indeed, how a task is performed represents key information for psychological and educational assessment. [...] Recently, process data has increasingly gained attention in cognitive ability testing given the digitalization of measurement and the possibility of exploiting log file data. [...] As shown by Maddox for large-scale assessments, even talk and gesture can be regarded as useful process data. In this case, the process data is not only video-recorded but also observed by the interviewer in situ; the interviewer interactively uses it to influence the test-taking process and to reduce construct-irrelevant variance. Thus, like product data (e.g., scores), process data is used to draw inferences. We argue in the following that the interpretation and use of process data and derived indicators require validation, just as product data do (Kane, 2013). This theoretical background, including some examples about log file data, sets the ground for our comments on Maddox's use of "talk and gesture as process data." (DIPF/Orig.)


DIPF-Abteilung:
Bildungsqualität und Evaluation

Notizen:

zuletzt verändert: 11.11.2016