-
-
Author(s): Di Mitri, Daniele; Schneider, Jan; Drachsler, Hendrik
Title: Keep me in the loop. Real-time feedback with multimodal data
In: International Journal of Artificial Intelligence in Education, 32 (2022) 4, S. 1093-1118
DOI: 10.1007/s40593-021-00281-z
URL: https://link.springer.com/article/10.1007/s40593-021-00281-z
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Datenanalyse; Datenverarbeitung; Effektivität; Empirische Untersuchung; Feedback; Fehler; Fertigkeit; Fragebogen; Lernprozess; Medizin; Psychomotorik; Simulation; System; Technologie; Teilnehmer; Tool; Training
Abstract (english): This paper describes the CPR Tutor, a real-time multimodal feedback system for cardiopulmonary resuscitation (CPR) training. The CPR Tutor detects training mistakes using recurrent neural networks. The CPR Tutor automatically recognises and assesses the quality of the chest compressions according to five CPR performance indicators. It detects training mistakes in real-time by analysing a multimodal data stream consisting of kinematic and electromyographic data. Based on this assessment, the CPR Tutor provides audio feedback to correct the most critical mistakes and improve the CPR performance. The mistake detection models of the CPR Tutor were trained using a dataset from 10 experts. Hence, we tested the validity of the CPR Tutor and the impact of its feedback functionality in a user study involving additional 10 participants. The CPR Tutor pushes forward the current state of the art of real-time multimodal tutors by providing: (1) an architecture design, (2) a methodological approach for delivering real-time feedback using multimodal data and (3) a field study on real-time feedback for CPR training. This paper details the results of a field study by quantitatively measuring the impact of the CPR Tutor feedback on the performance indicators and qualitatively analysing the participants' questionnaire answers. (DIPF/Orig.)
DIPF-Departments: Informationszentrum Bildung
-
-
Author(s): Brod, Garvin
Title: Predicting as a learning strategy
In: Psychonomic Bulletin & Review, 28 (2021) 6, S. 1839-1847
DOI: 10.3758/s13423-021-01904-1
URL: https://link.springer.com/article/10.3758/s13423-021-01904-1
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Lernstrategie; Prognose; Information; Wissen; Antwort; Gedächtnis; Kognitive Prozesse; Strategie; Vergleich; Neugier; Fehler; Feedback; Unterricht; Forschung
Abstract (english): This article attempts to delineate the procedural and mechanistic characteristics of predicting as a learning strategy. While asking students to generate a prediction before presenting the correct answer has long been a popular learning strategy, the exact mechanisms by which it improves learning are only beginning to be unraveled. Moreover, predicting shares many features with other retrieval-based learning strategies (e.g., practice testing, pretesting, guessing), which begs the question of whether there is more to it than getting students to engage in active retrieval. I argue that active retrieval as such does not suffice to explain beneficial effects of predicting. Rather, the effectiveness of predicting is also linked to changes in the way the ensuing feedback is processed. Initial evidence suggests that predicting boosts surprise about unexpected answers, which leads to enhanced attention to the correct answer and strengthens its encoding. I propose that it is this affective aspect of predicting that sets it apart from other retrieval-based learning strategies, particularly from guessing. Predicting should thus be considered as a learning strategy in its own right. Studying its unique effects on student learning promises to bring together research on formal models of learning from prediction error, epistemic emotions, and instructional design. (DIPF/Orig.)
DIPF-Departments: Bildung und Entwicklung
-
-
Author(s): Larhammar, Dan; Baghramian, Maria; Bianucci, Piero; Brod, Garvin; Dobiáš, Dalibor; Gelenbe, Erol; Kunelius, Risto; Leonardi, Stefano; Lewandowsky, Stephan; Oosterwegel, Mariëtte; Powell, Allison; Suiter, Jane
Title: Fact or fake? Tackling science disinformation
Published: Berlin: ALLEA | All European Academies, 2021
DOI: 10.26356/fact-or-fake
URL: https://allea.org/wp-content/uploads/2021/04/Fact-or-Fake-Discussion-Paper.pdf
Publication Type: 5. Arbeits- und Diskussionspapiere; weitere Arbeits- und Diskussionspapiere
Language: Englisch
Keywords: Wissenschaft; Information; Fehler; Intention; Merkmal; Verantwortung; Interessenpolitik; Wissenschaftskommunikation; Vertrauen; Medienkompetenz; Pandemie; Klimawandel
Abstract: ALLEA has a keen interest in the interrelationship of trust, science, and society, especially where it concerns or includes science communication. To understand and respond more effectively to the underlying causes of science disinformation, ALLEA and its Member Academies, with the support of Fondazione Compagnia di San Paolo, initiated the project 'Fact of Fake? Tackling Science Disinformation', the findings of which are presented in this paper by an interdisciplinary scientific committee (listed at the end). (DIPF/Orig.)
DIPF-Departments: Bildung und Entwicklung
-
-
Author(s): Brod, Garvin; Lee Shing, Yee
Title: A boon and a bane. Comparing the effects of prior knowledge on memory across the lifespan
In: Developmental Psychology, 55 (2019) 6, S. 1326-1337
DOI: 10.1037/dev0000712
URL: https://psycnet.apa.org/doiLanding?doi=10.1037%2Fdev0000712
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Vorwissen; Wissen; Wirkung; Gedächtnis; Lebensalter; Erinnerung; Fehler; Informationsverarbeitung; Objekt; Raum; Assoziation; Kind; Junger Erwachsener; Alter Mensch; Leistungsfähigkeit; Test; Altersgruppe; Vergleich
Abstract: We tested 6- to 7-year-olds, 18- to 22-year-olds, and 67- to 74-year-olds on an associative memory task that consisted of knowledge-congruent and knowledge-incongruent object-scene pairs that were highly familiar to all age groups. We compared the 3 age groups on their memory congruency effect (i.e., better memory for knowledge-congruent associations) and on a schema bias score, which measures participants' tendency to commit knowledge-congruent memory errors. We found that prior knowledge similarly benefited memory for items encoded in a congruent context in all age groups. However, for associative memory, older adults and, to a lesser extent, children overrelied on their prior knowledge, as indicated by an enhanced congruency effect and schema bias. Functional MRI (fMRI) performed during memory encoding revealed an age-independent Memory × Congruency interaction in the ventromedial prefrontal cortex (vmPFC). Furthermore, the magnitude of vmPFC recruitment correlated positively with the schema bias. These findings suggest that older adults are most prone to rely on their prior knowledge for episodic memory decisions, but that children can also rely heavily on prior knowledge that they are well acquainted with. Furthermore, the fMRI results suggest that the vmPFC plays a key role in the assimilation of new information into existing knowledge structures across the entire life span. vmPFC recruitment leads to better memory for knowledge-congruent information but also to a heightened susceptibility to commit knowledge-congruent memory errors, in particular in children and older adults. (DIPF/Orig.)
DIPF-Departments: Bildung und Entwicklung
-
-
Author(s): Di Mitri, Daniele; Schneider, Jan; Specht, Marcus; Drachsler, Hendrik
Title: Detecting mistakes in CPR training with multimodal data and neural networks
In: Sensors, 19 (2019) 14, S. 3099
DOI: 10.3390/s19143099
URL: https://www.mdpi.com/1424-8220/19/14/3099
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Beitrag in Sonderheft
Language: Englisch
Keywords: Neuropsychologie; Psychomotorik; Praktisches Lernen; Student; Medizin; Lernprozess; Datenanalyse; Computerprogramm; Messung; Fehler; Feedback; Automatisierung; Tutorensystem; Validität; Indikator
Abstract: This study investigated to what extent multimodal data can be used to detect mistakes during Cardiopulmonary Resuscitation (CPR) training. We complemented the Laerdal QCPR ResusciAnne manikin with the Multimodal Tutor for CPR, a multi-sensor system consisting of a Microsoft Kinect for tracking body position and a Myo armband for collecting electromyogram information. We collected multimodal data from 11 medical students, each of them performing two sessions of two-minute chest compressions (CCs). We gathered in total 5254 CCs that were all labelled according to five performance indicators, corresponding to common CPR training mistakes. Three out of five indicators, CC rate, CC depth and CC release, were assessed automatically by the ReusciAnne manikin. The remaining two, related to arms and body position, were annotated manually by the research team. We trained five neural networks for classifying each of the five indicators. The results of the experiment show that multimodal data can provide accurate mistake detection as compared to the ResusciAnne manikin baseline. We also show that the Multimodal Tutor for CPR can detect additional CPR training mistakes such as the correct use of arms and body weight. Thus far, these mistakes were identified only by human instructors. Finally, to investigate user feedback in the future implementations of the Multimodal Tutor for CPR, we conducted a questionnaire to collect valuable feedback aspects of CPR training. (DIPF/Orig.)
DIPF-Departments: Informationszentrum Bildung
-
-
Author(s): Käfer, Julia; Kuger, Susanne; Klieme, Eckhard; Kunter, Mareike
Title: The significance of dealing with mistakes for student achievement and motivation. Results of doubly latent multilevel analyses
In: European Journal of Psychology of Education, 34 (2019) 4, S. 731-753
DOI: 10.1007/s10212-018-0408-7
URN: urn:nbn:de:0111-pedocs-181284
URL: http://nbn-resolving.org/urn:nbn:de:0111-pedocs-181284
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Einstellung <Psy>; Schuljahr 09; Schulform; Leistungstest; Mehrebenenanalyse; Deutschland; Englischunterricht; Fremdsprachenunterricht; Fehler; Schüler; Lernerfolg; Einflussfaktor; Motivation; Wahrnehmung; Lehrer;
Abstract: Entsprechend der konstruktivistischen Lerntheorie werden Fehler als natürliche Bestandteile von Lernprozessen gesehen. Ein unterstützender und konstruktiver Umgang mit Schülerfehlern erweist sich dabei als besonders geeignet um motivationale wie kognitive Lernergebnisse von Lernenden positiv zu beeinflussen. Im Klassenkontext ist das Fehlermachen jedoch nicht nur ein individuelles, sondern auch ein soziales Ereignis. Der Umgang mit Fehlern sollte entsprechend auf Schüler- und auf Klassenebene betrachtet werden. Diese Studie untersucht drei Aspekte des Umgangs mit Fehlern und deren Relevanz für die Leistung und Motivation von Schülerinnen und Schülern im deutschen Englischunterricht. Die Aspekte werden dabei auf sowohl auf Schüler- wie auch auf Klassenebene analysiert. Die untersuchten Aspekte sind (a) die Einstellung des Lehrers zu Fehlern, (b) die Reaktion des Lehrers auf Fehler der Schüler und (c) die Wahrnehmung der Schüler hinsichtlich der Nützlichkeit von Fehlern im Lernprozess. Ausgewertet wurden Daten von 5266 Schülerinnen und Schülern aus 427 Klassen aller Schulformen in Deutschland. Die Ergebnisse zeigen, dass auf Schülerebene alle drei Aspekte die individuelle Leistung und die individuelle Motivation der Schüler im Englischunterricht beeinflussen. Auf Klassenebene beeinflusst keiner der Aspekte die durchschnittliche Leistung der Schüler. Zwei Aspekte beeinflussen die durchschnittliche Motivation der Schüler, nämlich (a) die Einstellung des Lehrers zu Fehlern und (c) die geteilte Wahrnehmung der Schüler hinsichtlich der Nützlichkeit von Fehlern im Lernprozess. Unsere Ergebnisse zeigen, dass die individuelle und die geteilte Wahrnehmung des Umgangs mit Fehlern die motivationalen und kognitiven Lernergebnisse von Schülerinnen und Schülern auf unterschiedliche Weise beeinflusst. Darüber hinaus unterstreichen unsere Ergebnisse die Relevanz der Lehrereinstellung sowie der Wahrnehmung der Lernenden hinsichtlich des Fehlermachens im Lernprozess für die Motivation der Schüler im Englischunterricht. (DIPF/Autor)
Abstract (english): From a constructivist perspective on learning, mistakes are seen as natural elements of learning processes. A supportive and constructive way of dealing with student mistakes has shown to affect students' individual motivation and learning performances in a favorable way. In classroom settings, however, making mistakes is not just a personal but also a social event. Dealing with mistakes should therefore be considered as both student-level and classroom-level characteristic. This study investigates three aspects of dealing with mistakes and their relevance for students' achievement and motivation in English as a foreign language by analyzing the aspects at student and classroom level. The aspects are (a) teacher attitude toward mistakes, (b) teacher response to student mistakes, and (c) students' perception of mistakes as useful for learning. Analyzing data of 5266 students from 427 classes in German secondary schools, the results demonstrate that at student level, all three aspects of dealing with mistakes affect students' individual achievement as well as motivation in English language class. At classroom level, none of the aspects affect student average achievement. Two aspects affect student average motivation at the classroom level, namely (a) teacher attitude toward mistakes and (c) students' shared perception of the usefulness of mistakes for learning. Our results show that students' individual and shared perception of dealing with mistakes affect students' motivational and cognitive learning outcomes in different ways. Furthermore, our findings underline the relevance of teachers' attitudes as well as students' perceptions concerning mistakes for student learning and motivation in English as a foreign language class. (DIPF/Orig.)
DIPF-Departments: Bildungsqualität und Evaluation
-
-
Author(s): Boer, Diana; Hanke, Katja; He, Jia
Title: On detecting systematic measurement error in cross-cultural research. A review and critical reflection on equivalence and invariance tests
In: Journal of Cross-Cultural Psychology, 49 (2018) 5, S. 713-734
DOI: 10.1177/0022022117749042
URL: https://journals.sagepub.com/doi/full/10.1177/0022022117749042
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Interkultureller Vergleich; Empirische Forschung; Messverfahren; Psychologische Forschung; Fehler; Kultureinfluss; Einflussfaktor; Kognition; Verhalten; Sprache; Validität; Taxonomie
Abstract: One major threat to revealing cultural influences on psychological states or processes is the presence of bias (i.e., systematic measurement error). When quantitative measures are not targeting the same construct or they differ in metric across cultures, the validity of inferences about cultural variability (and universality) is in doubt. The objectives of this article are to review what can be done about it and what is being done about it. To date, a multitude of useful techniques and methods to reduce or assess bias in cross-cultural research have been developed. We explore the limits of invariance/equivalence testing and suggest more flexible means of dealing with bias. First, we review currently available established and novel methods that reveal bias in cross-cultural research. Second, we analyze current practices in a systematic content analysis. The content analysis of more than 500 culture-comparative quantitative studies (published from 2008 to 2015 in three outlets in cross-cultural, social, and developmental psychology) aims to gauge current practices and approaches in the assessment of measurement equivalence/invariance. Surprisingly, the analysis revealed a rather low penetration of invariance testing in cross-cultural research. Although a multitude of classical and novel approaches for invariance testing is available, these are employed infrequent rather than habitual. We discuss reasons for this hesitation, and we derive suggestions for creatively assessing and handling biases across different research paradigms and designs. (DIPF/Orig.)
DIPF-Departments: Bildungsqualität und Evaluation
-
-
Author(s): Bonefeld, Meike; Dickhäuser, Oliver; Janke, Stefan; Praetorius, Anna-Katharina; Dresel, Markus
Title: Migrationsbedingte Disparitäten in der Notenvergabe nach dem Übergang auf das Gymnasium
In: Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie, 49 (2017) 1, S. 11-23
DOI: 10.1026/0049-8637/a000163
URN: urn:nbn:de:0111-pedocs-158613
URL: https://nbn-resolving.org/urn:nbn:de:0111-pedocs-158613
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Deutsch
Keywords: Baden-Württemberg; Deutschland; Einflussfaktor; Empirische Untersuchung; Fehler; Gymnasium; Längsschnittuntersuchung; Lehrer; Leistungsbeurteilung; Mathematikunterricht; Migrationshintergrund; Notengebung; Schüler; Schuljahr 05; Schuljahr 06; Soziale Herkunft; Sprachgebrauch; Test
Abstract: Disparitäten bei der Leistungsbewertung von Schülern und Schülerinnen mit Migrationshintergrund konnten häufig für den Übergang zwischen Grundschule und weiterführender Schule nachgewiesen werden. In der hier vorgestellten Studie wurde geprüft, ob sich solche Zusammenhänge auch nach dem Übergang auf das Gymnasium zeigen. Untersucht wurde der Effekt des Migrationshintergrundes von Schüler_innen auf die Leistungsbewertung im Fach Mathematik bei Klassenarbeiten und Zeugnissen. Daten von 1487 Gymnasiastinnen und Gymnasiasten und deren 56 Lehrkräften im Fach Mathematik zu fünf Messzeitpunkten (Beginn der fünften Klasse bis zum Ende der sechsten Klasse) zeigten, dass Schüler_innen nicht-deutscher Herkunft auch unter Kontrolle von Leistungen in standardisierten Tests signifikant schlechtere Klassenarbeits- und Zeugnisnoten erhielten. Der Effekt blieb im Zeitverlauf stabil. Diese Ergebnisse unterstützen die Hypothese, dass sich Urteilsfehler bei der Benotung von Leistungen von Schülern und Schülerinnen mit nichtdeutscher Herkunft zeigen. (DIPF/Orig.)
Abstract (english): Disparities in the educational outcomes of students with migration background were often detected for the transition from primary school to secondary school. Here we examined whether such disparities also persist after the transition to secondary school. Thereby, the present study considers the effect of migration background on students' grades in mathematics. The data of 1,487 secondary school students and their 56 teachers in mathematics based on five points of measurement (from the start of fifth grade until the end of sixth grade) showed that students with migration background obtained significantly worse grades in examinations and final school reports even after controlling for mathematical test performance. The effect was stable over time. These results support the hypothesis that a confirmation bias might exist in giving grades for students with a migration background. (DIPF/Orig.)
DIPF-Departments: Bildungsqualität und Evaluation
-
-
Author(s): Goldhammer, Frank; Steinwascher, Merle A.; Kroehne, Ulf; Naumann, Johannes
Title: Modeling individual response time effects between and within experimental speed conditions. A GLMM approach for speeded tests
In: British Journal of Mathematical and Statistical Psychology, 70 (2017) 2, S. 238-256
DOI: 10.1111/bmsp.12099
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Beitrag in Sonderheft
Language: Englisch
Keywords: Test; Testkonstruktion; Antwort; Dauer; Unterschied; Messverfahren; Entscheidung; Einflussfaktor; Fehler; Modell; Vergleich
Abstract: Completing test items under multiple speed conditions avoids the performance measure being confounded with individual differences in the speed-accuracy compromise, and offers insights into the response process, that is, how response time relates to the probability of a correct response. This relation is traditionally represented by two conceptually different functions: the speed-accuracy trade-off function (SATF) across conditions relating the condition average response time to the condition average of accuracy, and the conditional accuracy function (CAF) within a condition describing accuracy conditional on response time. Using a generalized linear mixed modelling approach, we propose an item response modelling framework that is suitable for item response and response time data from experimental speed conditions. The proposed SATF and CAF model accommodates response time effects between conditions (i.e., person and item SATF slope) and within conditions (i.e., residual CAF slopes), captures person and item differences in these effects, and is suitable for measures with a strong speed component. Moreover, for a single condition a CAF model is proposed distinguishing person, item and residual CAF. The properties of the models are illustrated with an empirical example. (DIPF/Orig.)
DIPF-Departments: Bildungsqualität und Evaluation
-
-
Author(s): Beinborn, Lisa; Zesch, Torsten; Gurevych, Iryna
Title: Predicting the spelling difficulty of words for language learners
In: Association for Computational Linguistic (Hrsg.): Proceedings of the 11th workshop on innovative use of NLP for building educational applications held in conjunction with NAACL 2016, Stroudsburg; PA: Association for Computational Linguistics, 2016 , S. 73-83
URL: https://www.ukp.tu-darmstadt.de/fileadmin/user_upload/Group_UKP/wall/BEA2016_SpellingDifficulty.pdf
Publication Type: 4. Beiträge in Sammelwerken; Tagungsband/Konferenzbeitrag/Proceedings
Language: Englisch
Keywords: Computerlinguistik; Deutsch; Englisch; Fehler; Fremdsprache; Italienisch; Modell; Muttersprache; Phonetik; Psycholinguistik; Rechtschreibung
Abstract (english): In many language learning scenarios, it is important to anticipate spelling errors. We model the spelling difficulty of words with new features that capture phonetic phenomena and are based on psycholinguistic findings. To train our model, we extract more than 140,000 spelling errors from three learner corpora covering English, German and Italian essays. The evaluation shows that our model can predict spelling difficulty with an accuracy of over 80% and yields a stable quality across corpora and languages. In addition, we provide a thorough error analysis that takes the native language of the learners into account and provides insights into cross-lingual transfer effects. (DIPF/Orig.)
DIPF-Departments: Informationszentrum Bildung