Menü Überspringen
Contact
Deutsch
English
Not track
Data Protection
Search
Log in
DIPF News
Research
Infrastructures
Institute
Zurück
Contact
Deutsch
English
Not track
Data Protection
Search
Home
>
Research
>
Publications
>
Open Access Repository
Search results in the DIPF database of publications
Your query:
(Schlagwörter: "Datenanalyse")
Advanced Search
Search term
Search
Unselect matches
Select all matches
Export
239
items matching your search terms.
Show all details
Practical significance of item misfit and its manifestations in constructs assessed in large‑scale […]
Fährmann, Katharina; Köhler, Carmen; Hartig, Johannes; Heine, Jörg‑Henrik
Journal Article
| In: Large-scale Assessments in Education | 2022
42893 Endnote
Author(s):
Fährmann, Katharina; Köhler, Carmen; Hartig, Johannes; Heine, Jörg‑Henrik
Title:
Practical significance of item misfit and its manifestations in constructs assessed in large‑scale studies
In:
Large-scale Assessments in Education, (2022) , S. 10:7
DOI:
10.1186/s40536‑022‑00124‑w
URL:
https://largescaleassessmentsineducation.springeropen.com/articles/10.1186/s40536-022-00124-w
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Englisch
Keywords:
Leistungstest; Item-Response-Theory; Modell; Korrelationsanalyse; Skalierung; Messung; Evaluation; PISA <Programme for International Student Assessment>; Datenanalyse; Kompetenz; Lesefertigkeit
Abstract (english):
When scaling psychological tests with methods of item response theory it is necessary to investigate to what extent the responses correspond to the model predictions. In addition to the statistical evaluation of item misfit, the question arises as to its practical significance. Although item removal is undesirable for several reasons, its practical consequences are rarely investigated and focus mostly on main survey data with pre-selected items. In this paper, we identify criteria to evaluate practical significance and discuss them with respect to various types of assessments and their particular purposes. We then demonstrate the practical consequences of item misfit using two data examples from the German PISA 2018 field trial study: one with cognitive data and one with non-cognitive/metacognitive data. For the former, we scale the data under the GPCM with and without the inclusion of misfitting items, and investigate how this influences the trait distribution and the allocation to reading competency levels. For non-cognitive/metacognitive data, we explore the effect of excluding misfitting items on estimated gender differences. Our results indicate minor practical consequences for person allocation and no changes in the estimated gender-difference effects. (DIPF/Orig.)
DIPF-Departments:
Lehr und Lernqualität in Bildungseinrichtungen
Prediction of disorientation by accelerometric and gait features in young and older adults […]
Teipel, Stefan J.; Amaefule, Chimezie O.; Lüdtke, Stefan; Görß, Doreen; Faraza, Sofia; Bruhn, Sven; […]
Journal Article
| In: Frontiers in Psychology | 2022
42734 Endnote
Author(s):
Teipel, Stefan J.; Amaefule, Chimezie O.; Lüdtke, Stefan; Görß, Doreen; Faraza, Sofia; Bruhn, Sven; Kirste, Thomas
Title:
Prediction of disorientation by accelerometric and gait features in young and older adults navigating in a virtually enriched environment
In:
Frontiers in Psychology, (2022) , S. 13:882446
DOI:
10.3389/fpsyg.2022.882446
URL:
https://www.frontiersin.org/articles/10.3389/fpsyg.2022.882446/full
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Englisch
Keywords:
Raum; Orientierung; Bewegung <Motorische>; Erwachsener; Alter; Kognitive Prozesse; Virtuelle Realität; Stadt; Experimentelle Untersuchung; Messung; Videoaufzeichnung; Datenanalyse; Empirische Untersuchung; Rostock; Deutschland
Abstract:
Objective: To determine whether gait and accelerometric features can predict disorientation events in young and older adults. Methods: Cognitively healthy younger (18-40 years, n = 25) and older (60-85 years, n = 28) participants navigated on a treadmill through a virtual representation of the city of Rostock featured within the Gait Real-Time Analysis Interactive Lab (GRAIL) system. We conducted Bayesian Poisson regression to determine the association of navigation performance with domain-specific cognitive functions. We determined associations of gait and accelerometric features with disorientation events in real-time data using Bayesian generalized mixed effect models. The accuracy of gait and accelerometric features to predict disorientation events was determined using cross-validated support vector machines (SVM) and Hidden Markov models (HMM). Results: Bayesian analysis revealed strong evidence for the effect of gait and accelerometric features on disorientation. The evidence supported a relationship between executive functions but not visuospatial abilities and perspective taking with navigation performance. Despite these effects, the cross-validated percentage of correctly assigned instances of disorientation was only 72% in the SVM and 63% in the HMM analysis using gait and accelerometric features as predictors. Conclusion: Disorientation is reflected in spatiotemporal gait features and the accelerometric signal as a potentially more easily accessible surrogate for gait features. At the same time, such measurements probably need to be enriched with other parameters to be sufficiently accurate for individual prediction of disorientation events. (DIPF/Orig.)
DIPF-Departments:
Bildung und Entwicklung
Zentrale quantitative Auswertungsverfahren
Becker, Michael; Maaz, Kai
Book Chapter
| Aus: Harring, Marius; Rohlfs, Carsten; Gläser-Zikuda, Michaela (Hrsg.): Handbuch Schulpädagogik | Münster: Waxmann | 2022
42715 Endnote
Author(s):
Becker, Michael; Maaz, Kai
Title:
Zentrale quantitative Auswertungsverfahren
In:
Harring, Marius; Rohlfs, Carsten; Gläser-Zikuda, Michaela (Hrsg.): Handbuch Schulpädagogik, Münster: Waxmann, 2022 , S. 948-958
Publication Type:
4. Beiträge in Sammelbänden; Lexika/Enzyklopädie o.ä.
Language:
Deutsch
Keywords:
Fehlende Daten; Quantitative Forschung; Schulforschung; Bildungsforschung; Statistische Methode; Modellierung; Stichprobe; Datenanalyse; Verfahren; Mehrebenenanalyse; Pfadanalyse; Skalierung; Längsschnittuntersuchung; Panel
Abstract:
[Im Beitrag wird] nach einer kurzen Darstellung der Gemeinsamkeiten statistischer Modellierung, die die Schul- und Bildungsforschung mit den meisten Sozialwissenschaften teilt, ein Überblick über die spezifischen Auswertungsverfahren gegeben, die sich vor allem in der quantitativen Bildungs- und Schulforschung häufig finden. Hierbei wird weniger auf die Darstellung spezifischer Kennwerte und ihrer Eigenschaften als auf die generelle Verwendung und den epistemologischen Zweck der Verfahren eingegangen. Der Fokus ist darauf gelegt, die wichtigsten statistischen Probleme und gegenwärtig gängigen analytischen Lösungen, wie sie in einer Vielzahl von Studien der Bildungs- und Schulforschung vorzufinden und zu adressieren sind, auf einer konzeptuellen Ebene zusammenzufassen und Hinweise für einen tieferen Einstieg in die Themen zu geben. Insofern sollen - nach einer kurzen Erläuterung der beiden grundlegenden Aspekte statistischer Modellierung (Deskriptive und Inferenzstatistik) im Allgemeinen - vier Aspekte quantitativer Auswertungen vorgestellt werden, wie sie unserer Meinung nach zentral für die quantitative Bildungs- und Schulforschung sind: (1) Hierarchische Datenstrukturen und Mehrebenenmodelle, (2) Pfadanalysen und längsschnittliche cross-lagged panel-Analysen, Fragen (3) fehlender Werte und (4) der Leistungsskalierung. (DIPF/Orig.)
DIPF-Departments:
Struktur und Steuerung des Bildungswesens
Kompetenzdiagnostik
Frey, Andreas; Hartig, Johannes
Book Chapter
| Aus: Harring, Marius; Rohlfs, Carsten; Gläser-Zikuda, Michaela (Hrsg.): Handbuch Schulpädagogik | Münster: Waxmann | 2022
42714 Endnote
Author(s):
Frey, Andreas; Hartig, Johannes
Title:
Kompetenzdiagnostik
In:
Harring, Marius; Rohlfs, Carsten; Gläser-Zikuda, Michaela (Hrsg.): Handbuch Schulpädagogik, Münster: Waxmann, 2022 , S. 928-937
Publication Type:
4. Beiträge in Sammelbänden; Lexika/Enzyklopädie o.ä.
Language:
Deutsch
Keywords:
Empirische Forschung; Kompetenz; Diagnostik; Schüler; Schullaufbahn; Schülerleistung; Leistungsmessung; Testkonstruktion; Testtheorie; Testauswertung; Psychometrie; Qualität; Testdurchführung; Planung; Datenanalyse; Interpretation
Abstract:
Mit dem vorliegenden Beitrag wird das Feld der Kompetenzdiagnostik zusammenfassend dargestellt. Konkret wird dabei beschrieben, (a) was unter Kompetenzdiagnostik zu verstehen ist und welche Ziele mit ihr verfolgt werden, (b) wie Kompetenztests entwickelt und (c) wie sie angewendet werden. Das Kapitel schließt mit einem zusammenfassenden Fazit und einem Ausblick auf künftige Entwicklungsmöglichkeiten im Bereich Kompetenzdiagnostik. (DIPF/Orig.)
DIPF-Departments:
Lehr und Lernqualität in Bildungseinrichtungen
Überzeugungen von Lehrkräften. Ihre Bedeutung für das pädagogische Handeln und die Lernergebnisse […]
Dohrmann, Julia
Monograph
| Münster: Waxmann | 2021
41327 Endnote
Author(s):
Dohrmann, Julia
Title:
Überzeugungen von Lehrkräften. Ihre Bedeutung für das pädagogische Handeln und die Lernergebnisse in den Fächern Englisch und Mathematik
Published:
Münster: Waxmann, 2021 (Empirische Erziehungswissenschaft, 78)
DOI:
10.31244/9783830994176
URN:
urn:nbn:de:0111-pedocs-224986
URL:
http://nbn-resolving.org/urn:nbn:de:0111-pedocs-224986
Publication Type:
1. Monographien (Autorenschaft); Monographie
Language:
Deutsch
Keywords:
20. Jahrhundert; Allgemeine Pädagogik; Bildungsgeschichte; Datenanalyse; Deutschland; Dissertation; Einflussfaktor; Einstellung; Empirische Forschung; Englischunterricht; Gesamtschule; Gymnasium; Handlungskompetenz; Hauptschule; Hessen; Item; Item-Response-Theorie; Lehrer; Lernergebnis; Mathematikunterricht; Merkmal; Niedersachsen; Nordrhein-Westfalen; Pädagogisches Handeln; Professionalisierung; Qualität; Realschule; Schülerleistung; Schulform; Schulforschung; Schuljahr 09; Schulkultur; Schulqualität; Sekundäranalyse; Test; Überzeugung; Unterricht; Unterrichtsforschung; Unterrichtsklima; Unterrichtspraxis; Unterrichtsqualität; Wandel
Abstract:
Pädagogische Überzeugungen von Lehrkräften sind ein zentraler Aspekt ihrer professionellen Kompetenz, der für Schul- und Unterrichtsqualität bedeutsam ist. In dieser Studie wird untersucht, mit welchen Unterrichtsmerkmalen allgemeine pädagogische Überzeugungen von Lehrkräften zusammenhängen und wie diese Überzeugungen, vermittelt über das Unterrichtshandeln, mit Lernergebnissen von Schülerinnen und Schülern korrespondieren. Dies geschieht durch eine Sekundäranalyse der Drei-Länder-Studie von Helmut Fend aus den Jahren 1978/79. Ziel der Arbeit ist es, die Beziehungen zwischen allgemeinpädagogischen Überzeugungen, Unterricht und Lernergebnissen unter Berücksichtigung des aktuellen theoretischen und methodischen Forschungsstandes zu analysieren. Es zeigt sich, dass im Englischunterricht die pädagogischen Überzeugungen der Lehrkräfte mit einem unterstützenden Unterrichtsklima und - vermittelt über adaptives Unterrichtshandeln - mit den Lernergebnissen der Schülerinnen und Schüler im affektiven Bereich zusammenhängen.
Abstract (english):
{Abstract_englisch}
DIPF-Departments:
Lehr und Lernqualität in Bildungseinrichtungen
The structure of academic self-concept. A methodological review and empirical illustration of […]
Arens, A. Katrin; Jansen, Malte; Preckel, Franzis; Schmidt, Isabelle; Brunner, Martin
Journal Article
| In: Review of Educational Research | 2021
40775 Endnote
Author(s):
Arens, A. Katrin; Jansen, Malte; Preckel, Franzis; Schmidt, Isabelle; Brunner, Martin
Title:
The structure of academic self-concept. A methodological review and empirical illustration of central models
In:
Review of Educational Research, 91 (2021) 1, S. 34-72
DOI:
10.3102/0034654320972186
URL:
https://journals.sagepub.com/doi/10.3102/0034654320972186
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Englisch
Keywords:
Selbstkonzept; Selbstwahrnehmung; Kognitive Kompetenz; Strukturmodell; Mehrdimensionalität; Theorie; Methodologie; Überblick; Datenanalyse; Sekundäranalyse; Schüler; Schuljahr 10; Empirische Forschung; Deutschland
Abstract:
The structure of academic self-concept (ASC) is assumed to be multidimensional and hierarchical. This methodological review considers the most central models depicting the structure of ASC: a higher-order factor model, the Marsh/Shavelson model, the nested Marsh/Shavelson model, a bifactor representation based on exploratory structural equation modeling, and a first-order factor model. We elaborate on how these models represent the theoretical assumptions on the structure of ASC and outline their inherent psychometric properties. We analyzed these models using a data set of German 10th-grade students (N = 1,232) including a wide range of domain-specific ASCs as well as general ASC. The correlations among ASCs and between ASCs and academic achievement varied depending on the structural model used. We conclude with discussing recommendations for research purposes and advantages and limitations of each ASC model. Our approach may also guide research on other affective or motivational constructs (e.g., academic anxiety or interest). (DIPF/Orig.)
DIPF-Departments:
Bildung und Entwicklung
Mobile sensing with smart wearables of the physical context of distance learning students to […]
Ciordas-Hertel, George-Petru; Rödling, Sebastian; Schneider, Jan; Di Mitri, Daniele; […]
Journal Article
| In: Sensors | 2021
42008 Endnote
Author(s):
Ciordas-Hertel, George-Petru; Rödling, Sebastian; Schneider, Jan; Di Mitri, Daniele; Weidlich, Joshua; Drachsler, Hendrik
Title:
Mobile sensing with smart wearables of the physical context of distance learning students to consider its effects on learning
In:
Sensors, 21 (2021) 19, S. 6649
DOI:
10.3390/s21196649
URL:
https://www.mdpi.com/1424-8220/21/19/6649
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Englisch
Keywords:
Lernen; Einflussfaktor; Lernumgebung; Lernort; Lernvoraussetzungen; Hausunterricht; Learning Analytics; Smartphone; Neue Technologien; Datenerhebung; Erhebungsinstrument; Software; Softwareentwicklung; Implementierung; Erwachsener; Fragebogen; Datenanalyse
Abstract:
Research shows that various contextual factors can have an impact on learning. Some of these factors can originate from the physical learning environment (PLE) in this regard. When learning from home, learners have to organize their PLE by themselves. This paper is concerned with identifying, measuring, and collecting factors from the PLE that may affect learning using mobile sensing. More specifically, this paper first investigates which factors from the PLE can affect distance learning. The results identify nine types of factors from the PLE associated with cognitive, physiological, and affective effects on learning. Subsequently, this paper examines which instruments can be used to measure the investigated factors. The results highlight several methods involving smart wearables (SWs) to measure these factors from PLEs successfully. Third, this paper explores how software infrastructure can be designed to measure, collect, and process the identified multimodal data from and about the PLE by utilizing mobile sensing. The design and implementation of the Edutex software infrastructure described in this paper will enable learning analytics stakeholders to use data from and about the learners' physical contexts. Edutex achieves this by utilizing sensor data from smartphones and smartwatches, in addition to response data from experience samples and questionnaires from learners' smartwatches. Finally, this paper evaluates to what extent the developed infrastructure can provide relevant information about the learning context in a field study with 10 participants. The evaluation demonstrates how the software infrastructure can contextualize multimodal sensor data, such as lighting, ambient noise, and location, with user responses in a reliable, efficient, and protected manner.
Abstract (english):
Research shows that various contextual factors can have an impact on learning. Some of these factors can originate from the physical learning environment (PLE) in this regard. When learning from home, learners have to organize their PLE by themselves. This paper is concerned with identifying, measuring, and collecting factors from the PLE that may affect learning using mobile sensing. More specifically, this paper first investigates which factors from the PLE can affect distance learning. The results identify nine types of factors from the PLE associated with cognitive, physiological, and affective effects on learning. Subsequently, this paper examines which instruments can be used to measure the investigated factors. The results highlight several methods involving smart wearables (SWs) to measure these factors from PLEs successfully. Third, this paper explores how software infrastructure can be designed to measure, collect, and process the identified multimodal data from and about the PLE by utilizing mobile sensing. The design and implementation of the Edutex software infrastructure described in this paper will enable learning analytics stakeholders to use data from and about the learners' physical contexts. Edutex achieves this by utilizing sensor data from smartphones and smartwatches, in addition to response data from experience samples and questionnaires from learners' smartwatches. Finally, this paper evaluates to what extent the developed infrastructure can provide relevant information about the learning context in a field study with 10 participants. The evaluation demonstrates how the software infrastructure can contextualize multimodal sensor data, such as lighting, ambient noise, and location, with user responses in a reliable, efficient, and protected manner.
DIPF-Departments:
Informationszentrum Bildung
Außerunterrichtliches Peer Tutoring mit deutsch-türkischsprachigen Grundschulkindern. […]
Decristan, Jasmin; Schastak, Martin; Reitenbach, Valentina; Rauch, Dominique
Journal Article
| In: Zeitschrift für Erziehungswissenschaft | 2021
41082 Endnote
Author(s):
Decristan, Jasmin; Schastak, Martin; Reitenbach, Valentina; Rauch, Dominique
Title:
Außerunterrichtliches Peer Tutoring mit deutsch-türkischsprachigen Grundschulkindern. Umsetzungsgenauigkeit und Umfang von bilingualer Kommunikation
In:
Zeitschrift für Erziehungswissenschaft, 24 (2021) 4, S. 841-860
DOI:
10.1007/s11618-021-01023-6
URN:
urn:nbn:de:0111-pedocs-252329
URL:
https://nbn-resolving.org/urn:nbn:de:0111-pedocs-252329
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Deutsch
Keywords:
Datenanalyse; Empirische Untersuchung; Deutschland; Grundschüler; Deutsch; Türkisch; Bilingualismus; Kooperatives Lernen; Kommunikation; Peergroup; Tutor; Tandem-Methode; Außerunterrichtliche Betreuung; Training; Rechnen; Leseförderung; Intervention; Implementierung; Umsetzung; Audioaufzeichnung;
Abstract:
Der vorliegende Beitrag fokussiert die Implementation von außerunterrichtlichen Peer Tutoring-Trainings im Lesen und Rechnen mit türkisch-deutschsprachigen Grundschulkindern. Hierbei bildeten jeweils zwei Grundschulkinder (Peers) ein Tandem, das von einer geschulten studentischen Trainingsleitung angeleitet wurde. Zur Erfassung der Implementation von Peer Tutoring-Elementen unter diesen Bedingungen wurde die Umsetzungsgenauigkeit herangezogen. Eine Besonderheit der Studie war, dass es einem Teil der Trainingsgruppen erlaubt war, beide Sprachen während des Trainings zu sprechen. Für die bilinguale Kommunikation wurden zusätzliche Operationalisierungen geprüft, um die Umsetzung bilingualer Kommunikation zu erfassen. Darüber hinaus wird im Beitrag konsequent zwischen der Implementation durch Trainingsleitungen und durch Lernende unterschieden. Die Ergebnisse unterstreichen die hohe Umsetzungsgenauigkeit der außerunterrichtlichen Peer Tutoring-Trainings. Sie zeigen aber auch auf, dass die Lernenden in diesem Setting nur wenig miteinander in ihrer Herkunftssprache kommunizierten und mehr türkischsprachige Impulse durch Trainingsleitungen nicht mit mehr bilingualer Kommunikation durch die Lernenden einherging. Der Beitrag liefert somit weitere Erkenntnisse zur Aktivierung und zum Umfang bilingualer Kommunikation beim kooperativen Lernen. (DIPF/Orig.)
Abstract (english):
The paper focusses on the implementation of extracurricular peer tutoring trainings in reading and arithmetic with Turkish-German primary school children. Two children formed a dyad and were accompanied by a trained undergraduate instructor. Adherence was used to measure the implementation of peer tutoring elements under these conditions. Some of the learners were allowed to speak both languages during the training. For bilingual communication, additional operationalizations were examined to capture its implementation. Furthermore, a consistent distinction is made between implementation by trainers and by peers. The results show high treatment adherence of extracurricular peer tutoring trainings. However, they also show that the learners communicated only little with each other in their language of origin and that more Turkish-language impulses by trainees did not correspond with more bilingual communication by the learners. The article thus provides further insights into the activation and extent of bilingual communication in cooperative learning. (DIPF/Orig.)
DIPF-Departments:
Bildung und Entwicklung; Lehr und Lernqualität in Bildungseinrichtungen
For unto every one that hath shall be given. Teachers' competence profiles regarding the promotion […]
Dignath, Charlotte
Journal Article
| In: Metacognition and Learning | 2021
42408 Endnote
Author(s):
Dignath, Charlotte
Title:
For unto every one that hath shall be given. Teachers' competence profiles regarding the promotion of self‑regulated learning moderate the effectiveness of short‑term teacher training
In:
Metacognition and Learning, 16 (2021) 3, S. 555-594
DOI:
10.1007/s11409-021-09271-x
URL:
https://link.springer.com/article/10.1007/s11409-021-09271-x
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Beitrag in Sonderheft
Language:
Englisch
Keywords:
Lehrer; Kompetenz; Lernen; Selbstregulation; Unterricht; Schüler; Förderung; Kognitive Prozesse; Metakognition; Motivation; Wissen; Überzeugung; Selbstwirksamkeit; Lehrerfortbildung; Training; Effektivität; Unterricht; Schüler; Förderung; Fragebogenerhebung; Datenanalyse; Chi-Quadrat Test; Regressionsanalyse; Faktorenanalyse; Empirische Untersuchung; Deutschland
Abstract (english):
Teachers play a major role in the effectiveness of student learning. Teacher's competence contributes to their classroom practice. We applied a generic model of teacher competence to the specific context of teachers' promotion of self-regulated learning (SRL) in the classroom, and investigated teachers' competence profiles regarding SRL (study 1) and how teachers' competence can moderate the effectiveness of teacher training (study 2). In the first step, in study 1 191 teachers were assessed according to different characteristics that have been found to be important aspects of teacher competence (knowledge, beliefs, and self-efficacy). To investigate how these characteristics co-occur in teachers we determined latent profiles of teacher competence regarding SRL. To this end, and the data were subjected to a latent profile analysis that yielded two levels of competence profile: low and high competence to promote SRL. These competence profiles were positively associated with teachers' self-reported SRL practice in the classroom. Next, to test whether these competence profiles affect teachers' competence development, we conducted a training study. In this study 2, we examined the effects of an 8-h long teacher training about SRL on the development of teachers' competence (knowledge, beliefs, self-efficacy) and on their SRL practice in the classroom with a repeated measures control group design. Forty-five teachers participated in the training, and these teachers and their 543 students evaluated the effectiveness of the training. Training effects were found on the teacher level, but not on the student level. Teachers who participated in the training outperformed the control teachers in their development of self-efficacy to foster SRL, and their perceived SRL practice. Moreover, teachers' competence profiles moderated the training effect, showing that teachers with an initially high competence benefitted more from the training. Applying a generic model of teacher competence to the context of promoting SRL seems beneficial to inspire future research on indicators of teachers' SRL practice. (DIPF/Orig.)
DIPF-Departments:
Lehr und Lernqualität in Bildungseinrichtungen
From byproduct to design factor. On validating the interpretation of process indicators based on […]
Goldhammer, Frank; Hahnel, Carolin; Kroehne, Ulf; Zehner, Fabian
Journal Article
| In: Large-scale Assessments in Education | 2021
41612 Endnote
Author(s):
Goldhammer, Frank; Hahnel, Carolin; Kroehne, Ulf; Zehner, Fabian
Title:
From byproduct to design factor. On validating the interpretation of process indicators based on log data
In:
Large-scale Assessments in Education, (2021) , S. 9:20
DOI:
10.1186/s40536-021-00113-5
URN:
urn:nbn:de:0111-pedocs-250050
URL:
https://nbn-resolving.org/urn:nbn:de:0111-pedocs-250050
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Englisch
Keywords:
Leistungstest; Logdatei; PISA <Programme for International Student Assessment>; PIAAC <Programme for the International Assessment of Adult Competencies>; Datenanalyse; Interpretation; Leistungsmessung; Messverfahren; Indikator; Typologie; Testkonstruktion; Testtheorie
Abstract (english):
International large-scale assessments such as PISA or PIAAC have started to provide public or scientific use files for log data; that is, events, event-related attributes and timestamps of test-takers' interactions with the assessment system. Log data and the process indicators derived from it can be used for many purposes. However, the intended uses and interpretations of process indicators require validation, which here means a theoretical and/or empirical justification that inferences about (latent) attributes of the test-taker's work process are valid. This article reviews and synthesizes measurement concepts from various areas, including the standard assessment paradigm, the continuous assessment approach, the evidence-centered design (ECD) framework, and test validation. Based on this synthesis, we address the questions of how to ensure the valid interpretation of process indicators by means of an evidence-centered design of the task situation, and how to empirically challenge the intended interpretation of process indicators by developing and implementing correlational and/or experimental validation strategies. For this purpose, we explicate the process of reasoning from log data to low-level features and process indicators as the outcome of evidence identification. In this process, contextualizing information from log data is essential in order to reduce interpretative ambiguities regarding the derived process indicators. Finally, we show that empirical validation strategies can be adapted from classical approaches investigating the nomothetic span and construct representation. Two worked examples illustrate possible validation strategies for the design phase of measurements and their empirical evaluation. (DIPF/Orig.)
DIPF-Departments:
Lehr und Lernqualität in Bildungseinrichtungen
Unselect matches
Select all matches
Export
1
2
3
...
20
>
Show all
(239)