-
-
Author(s): Di Mitri, Daniele; Schneider, Jan; Drachsler, Hendrik
Title: Keep me in the loop. Real-time feedback with multimodal data
In: International Journal of Artificial Intelligence in Education, 32 (2022) 4, S. 1093-1118
DOI: 10.1007/s40593-021-00281-z
URL: https://link.springer.com/article/10.1007/s40593-021-00281-z
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Datenanalyse; Datenverarbeitung; Effektivität; Empirische Untersuchung; Feedback; Fehler; Fertigkeit; Fragebogen; Lernprozess; Medizin; Psychomotorik; Simulation; System; Technologie; Teilnehmer; Tool; Training
Abstract (english): This paper describes the CPR Tutor, a real-time multimodal feedback system for cardiopulmonary resuscitation (CPR) training. The CPR Tutor detects training mistakes using recurrent neural networks. The CPR Tutor automatically recognises and assesses the quality of the chest compressions according to five CPR performance indicators. It detects training mistakes in real-time by analysing a multimodal data stream consisting of kinematic and electromyographic data. Based on this assessment, the CPR Tutor provides audio feedback to correct the most critical mistakes and improve the CPR performance. The mistake detection models of the CPR Tutor were trained using a dataset from 10 experts. Hence, we tested the validity of the CPR Tutor and the impact of its feedback functionality in a user study involving additional 10 participants. The CPR Tutor pushes forward the current state of the art of real-time multimodal tutors by providing: (1) an architecture design, (2) a methodological approach for delivering real-time feedback using multimodal data and (3) a field study on real-time feedback for CPR training. This paper details the results of a field study by quantitatively measuring the impact of the CPR Tutor feedback on the performance indicators and qualitatively analysing the participants' questionnaire answers. (DIPF/Orig.)
DIPF-Departments: Informationszentrum Bildung
-
-
Author(s): Persic-Beck, Lothar; Goldhammer, Frank; Kroehne, Ulf
Title: Disengaged response behavior when the response button is blocked. Evaluation of a micro-intervention
In: Frontiers in Psychology. Section Quantitative Psychology and Measurement, 13 (2022) , S. 954532
DOI: 10.3389/fpsyg.2022.954532
URL: https://www.frontiersin.org/articles/10.3389/fpsyg.2022.954532/full
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Antwort; Datenanalyse; Dauer; Effektivität; Einflussfaktor; Erwachsener; Evaluation; Frage; Intervention; Kompetenz; Leistungstest; Logdatei; Messung; Motivation; Technologiebasiertes Testen; Testkonstruktion; Validität; Verhalten; Verhaltensänderung
Abstract (english): In large-scale assessments, disengaged participants might rapidly guess on items or skip items, which can affect the score interpretation's validity. This study analyzes data from a linear computer-based assessment to evaluate a micro-intervention that blocked the possibility to respond for 2 s. The blocked response was implemented to prevent participants from accidental navigation and as a naive attempt to prevent rapid guesses and rapid omissions. The response process was analyzed by interpreting log event sequences within a finite-state machine approach. Responses were assigned to different response classes based on the event sequence. Additionally, post hoc methods for detecting rapid responses based on response time thresholds were applied to validate the classification. Rapid guesses and rapid omissions could be distinguished from accidental clicks by the log events following the micro-intervention. Results showed that the blocked response interfered with rapid responses but hardly led to behavioral changes. However, the blocked response could improve the post hoc detection of rapid responding by identifying responses that narrowly exceed time-bound thresholds. In an assessment context, it is desirable to prevent participants from accidentally skipping items, which in itself may lead to an increasing popularity of initially blocking responses. If, however, data from those assessments is analyzed for rapid responses, additional log data information should be considered.
DIPF-Departments: Lehr und Lernqualität in Bildungseinrichtungen
-
-
Author(s): Breitwieser, Jasmin; Brod, Garvin
Title: Cognitive prerequisites for generative learning. Why some learning strategies are more effective than others
In: Child Development, 92 (2021) 1, S. 258-272
DOI: 10.1111/cdev.13393
URN: urn:nbn:de:0111-pedocs-252348
URL: https://nbn-resolving.org/urn:nbn:de:0111-pedocs-252348
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Lernstrategie; Effektivität; Voraussetzung; Kognition; Unterschied; Lebensalter; Altersabhängigkeit; Schüler; Student; Empirische Untersuchung; Augenbewegung; Bewegungsanalyse; Frankfurt a.M.; Deutschland
Abstract: This study examined age‐related differences in the effectiveness of two generative learning strategies (GLSs). Twenty‐five children aged 9-11 and 25 university students aged 17-29 performed a facts learning task in which they had to generate either a prediction or an example before seeing the correct result. We found a significant Age × Learning Strategy interaction, with children remembering more facts after generating predictions rather than examples, whereas both strategies were similarly effective in adults. Pupillary data indicated that predictions stimulated surprise, whereas the effectiveness of example‐based learning correlated with children's analogical reasoning abilities. These findings suggest that there are different cognitive prerequisites for different GLSs, which results in varying degrees of strategy effectiveness by age.
DIPF-Departments: Bildung und Entwicklung
-
-
Author(s): Brod, Garvin
Title: Generative learning. Which strategies for what age?
In: Educational Psychology Review, 33 (2021) 4, S. 1295-1318
DOI: 10.1007/s10648-020-09571-9
URN: urn:nbn:de:0111-pedocs-237048
URL: https://nbn-resolving.org/urn:nbn:de:0111-pedocs-237048
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Lernen; Strategie; Effektivität; Aktives Lernen; Kind; Lebensalter; Entwicklung; Unterschied; Lerntechnik; Forschungsüberblick
Abstract: Generative learning strategies are intended to improve students' learning by prompting them to actively make sense of the material to be learned. But are they effective for all students? This review provides an overview of six popular generative learning strategies: concept mapping, explaining, predicting, questioning, testing, and drawing. Its main purpose is to review for what ages the effectiveness of these strategies has been demonstrated and whether there are indications of age-related differences in their effectiveness. The description of each strategy covers (1) how it is supposed to work, (2) the evidence on its effectiveness in different age groups, and (3) if there are age-related differences in its effectiveness. It is found that while all six generative learning strategies reviewed have proven effective for university students, evidence is mixed for younger students. Whereas some strategies (practice testing, predicting) seem to be effective already in lower-elementary-school children, others (drawing, questioning) seem to be largely ineffective until secondary school. The review closes with a call for research on the cognitive and metacognitive prerequisites of generative learning that can explain these differences.
DIPF-Departments: Bildung und Entwicklung
-
-
Author(s): Dignath, Charlotte
Title: For unto every one that hath shall be given. Teachers' competence profiles regarding the promotion of self‑regulated learning moderate the effectiveness of short‑term teacher training
In: Metacognition and Learning, 16 (2021) 3, S. 555-594
DOI: 10.1007/s11409-021-09271-x
URL: https://link.springer.com/article/10.1007/s11409-021-09271-x
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Beitrag in Sonderheft
Language: Englisch
Keywords: Lehrer; Kompetenz; Lernen; Selbstregulation; Unterricht; Schüler; Förderung; Kognitive Prozesse; Metakognition; Motivation; Wissen; Überzeugung; Selbstwirksamkeit; Lehrerfortbildung; Training; Effektivität; Unterricht; Schüler; Förderung; Fragebogenerhebung; Datenanalyse; Chi-Quadrat Test; Regressionsanalyse; Faktorenanalyse; Empirische Untersuchung; Deutschland
Abstract (english): Teachers play a major role in the effectiveness of student learning. Teacher's competence contributes to their classroom practice. We applied a generic model of teacher competence to the specific context of teachers' promotion of self-regulated learning (SRL) in the classroom, and investigated teachers' competence profiles regarding SRL (study 1) and how teachers' competence can moderate the effectiveness of teacher training (study 2). In the first step, in study 1 191 teachers were assessed according to different characteristics that have been found to be important aspects of teacher competence (knowledge, beliefs, and self-efficacy). To investigate how these characteristics co-occur in teachers we determined latent profiles of teacher competence regarding SRL. To this end, and the data were subjected to a latent profile analysis that yielded two levels of competence profile: low and high competence to promote SRL. These competence profiles were positively associated with teachers' self-reported SRL practice in the classroom. Next, to test whether these competence profiles affect teachers' competence development, we conducted a training study. In this study 2, we examined the effects of an 8-h long teacher training about SRL on the development of teachers' competence (knowledge, beliefs, self-efficacy) and on their SRL practice in the classroom with a repeated measures control group design. Forty-five teachers participated in the training, and these teachers and their 543 students evaluated the effectiveness of the training. Training effects were found on the teacher level, but not on the student level. Teachers who participated in the training outperformed the control teachers in their development of self-efficacy to foster SRL, and their perceived SRL practice. Moreover, teachers' competence profiles moderated the training effect, showing that teachers with an initially high competence benefitted more from the training. Applying a generic model of teacher competence to the context of promoting SRL seems beneficial to inspire future research on indicators of teachers' SRL practice. (DIPF/Orig.)
DIPF-Departments: Lehr und Lernqualität in Bildungseinrichtungen
-
-
Author(s): Grützmacher, Luisa; Vieluf, Svenja; Hartig, Johannes
Title: Are questionnaire scales which measure non-cognitive constructs suitable as school effectiveness criteria? A measurement invariance analysis
In: School Effectiveness and School Improvement, 32 (2021) 3, S. 430-447
DOI: 10.1080/09243453.2021.1903511
URL: https://www.tandfonline.com/doi/full/10.1080/09243453.2021.1903511
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Schule; Effektivität; Messverfahren; Fragebogen; Reliabilität; Validität; Schüler; Sekundarbereich; Deutschunterricht; Lesen; Einstellung <Psy>; Mathematikunterricht; Interesse; Selbstkonzept; Mitarbeit; Längsschnittuntersuchung; Datenanalyse; Hamburg; Deutschland
Abstract (english): This study aimed at examining the suitability of questionnaire instruments commonly used in large-scale assessments for measuring non-cognitive school effectiveness criteria. It focused on questions of reliability and validity for capturing changes in students within schools across time and the instruments' sensitivity to school effects. The aim was also to propose an approach for analyzing measurement invariance across levels and time simultaneously. The study used longitudinal data from the KESS (Kompetenzen und Einstellungen von Schülerinnen und Schülern [competencies and attitudes of students]) study, conducted in Hamburg, Germany. The sample is comprised of 17,926 students in 189 secondary schools. Data were collected three or four times. The results of the analyses show that all investigated scales are suitable in terms of reliability and validity. However, only the scale interest in mathematics is sensitive to school effects and therefore suitable as a school effectiveness criterion. (DIPF/Orig.)
DIPF-Departments: Lehr und Lernqualität in Bildungseinrichtungen
-
-
Editor(s) Praetorius, Anna-Katharina; Grünkorn, Juliane; Klieme, Eckhard
Title: Empirische Forschung zu Unterrichtsqualität. Theoretische Grundfragen und quantitative Modellierungen
Published: Weinheim: Beltz Juventa, 2020 (Zeitschrift für Pädagogik. Beiheft, 66)
Publication Type: 2. Herausgeberschaft; Zeitschriftensonderheft
Language: Englisch; Deutsch
Keywords: Effektivität; Methodologie; Fachdidaktik; Unterrichtsprotokoll; Qualitätsentwicklung; Mehrebenenanalyse; Evaluation; Metaanalyse; Empirische Forschung; Unterricht; Qualität; Theorie; Modell; Naturwissenschaftlicher Unterricht; Nutzenansatz; Lehren; Lernen; Wirkung; Bildungsangebot; Nutzung; Unterrichtsforschung; Lernzeit; Messung; Messverfahren; Klassenführung; Lehrer; Schüler; Wahrnehmung
Abstract: Ziel des 66. Beiheftes ist es, basierend auf dem aktuellen Erkenntnisstand, aber auch aus einer Meta-Perspektive heraus, zentrale theoretische und methodologische Herausforderungen des Forschungsfeldes Unterrichtsqualität zu identifizieren und eine Plattform für die dezidiert (selbst-)kritische Auseinandersetzung mit diesen zu bieten. (DIPF/Orig.)
DIPF-Departments: Bildungsqualität und Evaluation
-
-
Author(s): Brod, Garvin; Breitwieser, Jasmin; Hasselhorn, Marcus; Bunge, Silvia
Title: Being proven wrong elicits learning in children - but only in those with higher executive function skills
In: Developmental Science, 23 (2020) 3, S. e12916
DOI: 10.1111/desc.12916
URN: urn:nbn:de:0111-dipfdocs-233156
URL: https://nbn-resolving.org/urn:nbn:de:0111-dipfdocs-233156
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Kind; Test; Experiment; Glaubenswissen; Kognitiver Konflikt; Erwartung; Vorhersage; Überraschung; Exekutive Funktionen; Lerneffekt
Abstract: This study investigated whether prompting children to generate predictions about an outcome facilitates activation of prior knowledge and improves belief revision. 51 children aged 9-12 were tested on two experimental tasks in which generating a prediction was compared to closely matched control conditions, as well as on a test of executive functions (EF). In Experiment 1, we showed that children exhibited a pupillary surprise response to events that they had predicted incorrectly, hypothesized to reflect the transient release of noradrenaline in response to cognitive conflict. However, children's surprise response was not associated with better belief revision, in contrast to a previous study involving adults. Experiment 2 revealed that, while generating predictions helped children activate their prior knowledge, only those with better inhibitory control skills learned from incorrectly predicted outcomes. Together, these results suggest that good inhibitory control skills are needed for learning through cognitive conflict. Thus, generating predictions benefits learning - but only among children with sufficient EF capacities to harness surprise for revising their beliefs. (DIPF/Orig.)
DIPF-Departments: Bildung und Entwicklung
-
-
Author(s): Decristan, Jasmin; Hess, Miriam; Holzberger, Doris; Praetorius, Anna-Katharina
Title: Oberflächen- und Tiefenmerkmale. Eine Reflexion zweier prominenter Begriffe der Unterrichtsforschung
In: Zeitschrift für Pädagogik. Beiheft, 66 (2020) , S. 102-116
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Beitrag in Sonderheft
Language: Deutsch
Keywords: Theoriebildung; Unterrichtsforschung; Begriff; Definition; Unterricht; Qualität; Struktur; Unterrichtsmethode; Effektivität; Unterrichtsgestaltung; Theorie; Modell; Pädagogische Psychologie
Abstract: Das Begriffspaar 'Oberflächenmerkmale'/'Oberflächenstrukturen' und 'Tiefenmerkmale'/'Tiefenstrukturen' hat zunehmend EInzug in die Forschungsliteratur erhalten, soll es doch eine Brücke zur Verknüpfung von Lehren und Lernen schlagen. Im vorliegenden Beitrag wird nach einem Überblick zu den historischen Wurzeln das Verständnis der jeweiligen Begriffe zusammengefasst. Anhand von Arbeiten aus der (Fach-)Didaktik und der pädagogisch-psychologischen Unterrichtsforschung werden unterschiedliche Konzeptualisierung von Tiefenmerkmalen aufgezeigt und Befunde zur Lernwirksamkeit von Tiefenmerkmalen angeführt. Der Beitrag schließt mit Vorschlägen zur begrifflichen Schärfungen und diskutiert theoretische und empirische Desiderata bezogen auf das Begriffspaar. (DIPF/Orig.)
DIPF-Departments: Bildungsqualität und Evaluation
-
-
Author(s): Gräsel, Cornelia; Schledjewski, Janine; Hartmann, Ulrike
Title: Implementation digitaler Medien als Schulentwicklungsaufgabe
In: Zeitschrift für Pädagogik, 66 (2020) 2, S. 208-224
DOI: 10.3262/ZP2002208
URN: urn:nbn:de:0111-pedocs-236290
URL: https://nbn-resolving.org/urn:nbn:de:0111-pedocs-236290
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Deutsch
Keywords: Curriculum; Deutschland; Digitale Medien; Digitalisierung; Effektivität; Einflussfaktor; Einstellung <Psy>; Forschungsstand; Herausforderung; Implementierung; Lehrer; Lerngemeinschaft; Lernumgebung; Medienausstattung; Medienkompetenz; Mediennutzung; Medienpädagogik; Modell; Rahmenplan; Schule; Schulentwicklung; Schulleitung; Schulprogramm; Umsetzung
Abstract: Es lässt sich konstatieren, dass Deutschland einen deutlichen Be- darf in Hinblick auf die Digitalisierung von Schule und Unterricht hat, obwohl seit den 1990er Jahren zahlreiche Implementationsprojekte durchgeführt wurden. Zentraler In- halt des Beitrags ist es, die Entwicklung und den derzeitigen Stand der Implementation digitaler Medien in Deutschland anhand eines Modells der Schulentwicklung darzustellen, das sich an Input-, Prozess- und Outputmodellen der Schulentwicklungs- und Schul- effektivitätsforschung orientiert. Abschließend wird unter Berücksichtigung internationaler Implementationsprojekte und -erfahrungen ein Fazit gezogen, welche Hinweise sich für Projekte und Forschung ergeben, die sich mit der Verbreitung digitaler Medien als Schulentwicklungsaufgabe befassen.
DIPF-Departments: Bildungsqualität und Evaluation