-
-
Your search query has too many results, only about 500 are displayed. Please use the advanced search.
-
-
Author(s): Frey, Andreas; Hartig, Johannes
Title: Kompetenzdiagnostik
In: Harring, Marius; Rohlfs, Carsten; Gläser-Zikuda, Michaela (Hrsg.): Handbuch Schulpädagogik, Münster: Waxmann, 2022 , S. 928-937
Publication Type: 4. Beiträge in Sammelbänden; Lexika/Enzyklopädie o.ä.
Language: Deutsch
Keywords: Empirische Forschung; Kompetenz; Diagnostik; Schüler; Schullaufbahn; Schülerleistung; Leistungsmessung; Testkonstruktion; Testtheorie; Testauswertung; Psychometrie; Qualität; Testdurchführung; Planung; Datenanalyse; Interpretation
Abstract: Mit dem vorliegenden Beitrag wird das Feld der Kompetenzdiagnostik zusammenfassend dargestellt. Konkret wird dabei beschrieben, (a) was unter Kompetenzdiagnostik zu verstehen ist und welche Ziele mit ihr verfolgt werden, (b) wie Kompetenztests entwickelt und (c) wie sie angewendet werden. Das Kapitel schließt mit einem zusammenfassenden Fazit und einem Ausblick auf künftige Entwicklungsmöglichkeiten im Bereich Kompetenzdiagnostik. (DIPF/Orig.)
DIPF-Departments: Lehr und Lernqualität in Bildungseinrichtungen
-
-
Author(s): Dohrmann, Julia
Title: Überzeugungen von Lehrkräften. Ihre Bedeutung für das pädagogische Handeln und die Lernergebnisse in den Fächern Englisch und Mathematik
Published: Münster: Waxmann, 2021 (Empirische Erziehungswissenschaft, 78)
DOI: 10.31244/9783830994176
URN: urn:nbn:de:0111-pedocs-224986
URL: http://nbn-resolving.org/urn:nbn:de:0111-pedocs-224986
Publication Type: 1. Monographien (Autorenschaft); Monographie
Language: Deutsch
Keywords: 20. Jahrhundert; Allgemeine Pädagogik; Bildungsgeschichte; Datenanalyse; Deutschland; Dissertation; Einflussfaktor; Einstellung; Empirische Forschung; Englischunterricht; Gesamtschule; Gymnasium; Handlungskompetenz; Hauptschule; Hessen; Item; Item-Response-Theorie; Lehrer; Lernergebnis; Mathematikunterricht; Merkmal; Niedersachsen; Nordrhein-Westfalen; Pädagogisches Handeln; Professionalisierung; Qualität; Realschule; Schülerleistung; Schulform; Schulforschung; Schuljahr 09; Schulkultur; Schulqualität; Sekundäranalyse; Test; Überzeugung; Unterricht; Unterrichtsforschung; Unterrichtsklima; Unterrichtspraxis; Unterrichtsqualität; Wandel
Abstract: Pädagogische Überzeugungen von Lehrkräften sind ein zentraler Aspekt ihrer professionellen Kompetenz, der für Schul- und Unterrichtsqualität bedeutsam ist. In dieser Studie wird untersucht, mit welchen Unterrichtsmerkmalen allgemeine pädagogische Überzeugungen von Lehrkräften zusammenhängen und wie diese Überzeugungen, vermittelt über das Unterrichtshandeln, mit Lernergebnissen von Schülerinnen und Schülern korrespondieren. Dies geschieht durch eine Sekundäranalyse der Drei-Länder-Studie von Helmut Fend aus den Jahren 1978/79. Ziel der Arbeit ist es, die Beziehungen zwischen allgemeinpädagogischen Überzeugungen, Unterricht und Lernergebnissen unter Berücksichtigung des aktuellen theoretischen und methodischen Forschungsstandes zu analysieren. Es zeigt sich, dass im Englischunterricht die pädagogischen Überzeugungen der Lehrkräfte mit einem unterstützenden Unterrichtsklima und - vermittelt über adaptives Unterrichtshandeln - mit den Lernergebnissen der Schülerinnen und Schüler im affektiven Bereich zusammenhängen.
Abstract (english): {Abstract_englisch}
DIPF-Departments: Lehr und Lernqualität in Bildungseinrichtungen
-
-
Editor(s) Reh, Sabine; Bühler, Patrick; Hofmann, Michéle; Moser, Vera
Title: Schülerauslese, schulische Beurteilung und Schülertests 1880-1980
Published: Bad Heilbrunn: Klinkhardt, 2021
DOI: 10.25656/01:22266
URN: urn:nbn:de:0111-pedocs-222669
URL: https://www.pedocs.de/frontdoor.php?source_opus=22266
Publication Type: 2. Herausgeberschaft; Sammelband (keine besondere Kategorie)
Language: Deutsch
Keywords: 19. Jahrhundert; 20. Jahrhundert; Abitur; Abiturprüfung; Aufsatz; Auslese; Ausleseverfahren; Begabung; Beobachtung; Berufsberatung; Berufseignung; Berufspsychologie; Bildungsfähigkeit; Bildungsgeschichte; Deutschland; Deutschland-BRD; Deutschland-DDR; Diagnose; Diagnostik; Differenzierung; Exklusion; Experiment; Fallbeispiel; Förderklasse; Gehirn; Gehirnschädigung; Geistige Behinderung; Geschichte <Histor>; Gutachten; Handschrift; Heterogenität; Hilfsschule; Historische Bildungsforschung; Historische Quelle; Hochbegabung; Inklusion; Intelligenzschwäche; Intelligenztest; Kaiserreich; Kategorisierung; Kriegsbeschädigter; Leistungsbeurteilung; Leistungsmessung; Lernbehinderung; Lernschwäche; Maßnahme; Migrant; Migrationshintergrund; New York; NY; Pädagogik; Pädagogische Diagnostik; Pädagogische Psychologie; Preußen; Primarbereich; Psychiatrie; Reform; Schrift; Schuleignung; Schüler; Schülerbeurteilung; Schulgeschichte; Schulische Integration; Schulpsychologie; Schulsystem; Schweiz; Selektion; Soldat; Sonderpädagogik; Sonderpädagogische Einrichtung; Sonderschule; Sonderschulpädagogik; Stern; William Louis; Test; Übergang Primarstufe - Sekundarstufe I; Übungsschule; USA; Vergleich; Weimarer Republik
Abstract: Über den schulischen Umgang mit einer "Heterogenität" der Schüler*innen wird seit einer Reihe von Jahren heftig debattiert. Der vorliegende Band zeigt, wie seit dem letzten Drittel des 19. Jahrhunderts die Beobachtung von Unterschieden - solchen der Begabung, des Verhaltens und des Interesses - zwischen Schüler*innen in den Schulen mehr und mehr in das Blickfeld rückte. Auseinandersetzungen darüber, wie vor diesem Hintergrund "passende" Lerngruppen zusammengestellt werden sollten, bestimmten zunehmend das Bild der pädagogischen und schulpolitischen Debatten. Rekonstruiert werden Selektionsmechanismen im Schulsystem zwischen 1880 und 1980, mit denen zwischen Normalen und Nicht-Normalen, zwischen Begabten und Minderbegabten, zwischen solchen, die sich anpassten, und solchen, die das nicht taten, unterschieden wurde. Die Beiträge untersuchen Praktiken des Beobachtens, Prüfens und Beurteilens von Schüler*innen, die dafür eingesetzten Verfahren und Tests sowie die damit verbundenen individuellen, pädagogischen und politischen Bedingungen und Folgen. (DIPF/Orig.)
DIPF-Departments: Bibliothek für Bildungsgeschichtliche Forschung
-
-
Author(s): Becker, Benjamin; Debeer, Dries; Weirich, Sebastian; Goldhammer, Frank
Title: On the speed sensitivity parameter in the lognormal model for response times. Implications for test assembly
In: Applied Psychological Measurement, 45 (2021) 6, S. 407-422
DOI: 10.1177/01466216211008530
URL: https://journals.sagepub.com/doi/abs/10.1177/01466216211008530
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Software; Technologiebasiertes Testen; Messverfahren; Item-Response-Theory; Leistungstest; Frage; Antwort; Dauer; Einflussfaktor; Testkonstruktion; Modell; Vergleich; Testtheorie; Simulation
Abstract: In high-stakes testing, often multiple test forms are used and a common time limit is enforced. Test fairness requires that ability estimates must not depend on the administration of a specific test form. Such a requirement may be violated if speededness differs between test forms. The impact of not taking speed sensitivity into account on the comparability of test forms regarding speededness and ability estimation was investigated. The lognormal measurement model for response times by van der Linden was compared with its extension by Klein Entink, van der Linden, and Fox, which includes a speed sensitivity parameter. An empirical data example was used to show that the extended model can fit the data better than the model without speed sensitivity parameters. A simulation was conducted, which showed that test forms with different average speed sensitivity yielded substantial different ability estimates for slow test takers, especially for test takers with high ability. Therefore, the use of the extended lognormal model for response times is recommended for the calibration of item pools in high-stakes testing situations. Limitations to the proposed approach and further research questions are discussed. (DIPF/Orig.)
Abstract (english): In high-stakes testing, often multiple test forms are used and a common time limit is enforced. Test fairness requires that ability estimates must not depend on the administration of a specific test form. Such a requirement may be violated if speededness differs between test forms. The impact of not taking speed sensitivity into account on the comparability of test forms regarding speededness and ability estimation was investigated. The lognormal measurement model for response times by van der Linden was compared with its extension by Klein Entink, van der Linden, and Fox, which includes a speed sensitivity parameter. An empirical data example was used to show that the extended model can fit the data better than the model without speed sensitivity parameters. A simulation was conducted, which showed that test forms with different average speed sensitivity yielded substantial different ability estimates for slow test takers, especially for test takers with high ability. Therefore, the use of the extended lognormal model for response times is recommended for the calibration of item pools in high-stakes testing situations. Limitations to the proposed approach and further research questions are discussed. (DIPF/Orig.)
DIPF-Departments: Lehr und Lernqualität in Bildungseinrichtungen
-
-
Author(s): Brose, Annette; Blanke, Elisabeth S.; Schmiedek, Florian; Kramer, Andrea C.; Schmidt, Andrea; Neubauer, Andreas B.
Title: Change in mental health symptoms during the COVID-19 pandemic. The role of appraisals and daily life experiences
In: Journal of Personality, 89 (2021) 3, S. 468-482
DOI: 10.1111/jopy.12592
URL: https://onlinelibrary.wiley.com/doi/10.1111/jopy.12592
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Affekt; Emotionaler Zustand; Bewertung; Pandemie; Stress; Wohlbefinden; Achtsamkeit; Psychohygiene; Alltag; Erfahrung; Empirische Untersuchung; Tagebuch; Pretest; Deutschland
Abstract: Intro: When confronted with major threats, people often experience decline in well‐being. The central purpose of this study was to identify mechanisms underlying change of well‐being in times of threat, using the example of the COVID‐19 pandemic, with a focus on appraisals of the pandemic and affective states, stress, as well as mindfulness in daily life.
Methods: We conducted a study across 3.5 weeks, including pretest, posttest, and a diary phase in‐between. We worked with a sample of 460 adults, pre‐ and post‐test information, as well as 7189 observations from the diary phase.
Results: Results showed that deterioration in mental health symptoms across the duration of the study was associated with (a) change towards less fortunate appraisals of the pandemic and (b), more negative affect and less mindfulness in daily life. Furthermore, appraisals of the pandemic at pretest predicted experiences in daily life, with more negative appraisals of the pandemic predicting more negative affect and stressor occurrence as well as less mindfulness.
Discussion: These findings speak to the dynamic nature of well‐being and appraisals in times of threat, and highlight the role of experiences in daily life in changes in well‐being. (DIPF/Orig.)
DIPF-Departments: Bildung und Entwicklung
-
-
Author(s): Deribo, Tobias; Kröhne, Ulf; Goldhammer, Frank
Title: Model‐based treatment of rapid guessing
In: Journal of Educational Measurement, 58 (2021) 2, S. 281-303
DOI: 10.1111/jedm.12290
URL: https://onlinelibrary.wiley.com/doi/10.1111/jedm.12290?af=R
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Leistungstest; Testkonstruktion; Messverfahren; Computerunterstütztes Verfahren; Frage; Antwort; Verhalten; Dauer; Problemlösen; Modell; Student; Medienkompetenz; Item-Response-Theory; Multiple-Choice-Verfahren; Validität; Panel; Längsschnittuntersuchung
Abstract (english): The increased availability of time-related information as a result of computer-based assessment has enabled new ways to measure test-taking engagement. One of these ways is to distinguish between solution and rapid guessing behavior. Prior research has recommended response-level filtering to deal with rapid guessing. Response-level filtering can lead to parameter bias if rapid guessing depends on the measured trait or (un-)observed covariates. Therefore, a model based on Mislevy and Wu (1996) was applied to investigate the assumption of ignorable missing data underlying response-level filtering. The model allowed us to investigate different approaches to treating response-level filtered responses in a single framework through model parameterization. The study found that lower-ability test-takers tend to rapidly guess more frequently and are more likely to be unable to solve an item they guessed on, indicating a violation of the assumption of ignorable missing data underlying response-level filtering. Further ability estimation seemed sensitive to different approaches to treating response-level filtered responses. Moreover, model-based approaches exhibited better model fit and higher convergent validity evidence compared to more naïve treatments of rapid guessing. The results illustrate the need to thoroughly investigate the assumptions underlying specific treatments of rapid guessing as well as the need for robust methods. (DIPF/Orig.)
DIPF-Departments: Lehr und Lernqualität in Bildungseinrichtungen
-
-
Author(s): Dignath, Charlotte
Title: For unto every one that hath shall be given. Teachers' competence profiles regarding the promotion of self‑regulated learning moderate the effectiveness of short‑term teacher training
In: Metacognition and Learning, 16 (2021) 3, S. 555-594
DOI: 10.1007/s11409-021-09271-x
URL: https://link.springer.com/article/10.1007/s11409-021-09271-x
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Beitrag in Sonderheft
Language: Englisch
Keywords: Lehrer; Kompetenz; Lernen; Selbstregulation; Unterricht; Schüler; Förderung; Kognitive Prozesse; Metakognition; Motivation; Wissen; Überzeugung; Selbstwirksamkeit; Lehrerfortbildung; Training; Effektivität; Unterricht; Schüler; Förderung; Fragebogenerhebung; Datenanalyse; Chi-Quadrat Test; Regressionsanalyse; Faktorenanalyse; Empirische Untersuchung; Deutschland
Abstract (english): Teachers play a major role in the effectiveness of student learning. Teacher's competence contributes to their classroom practice. We applied a generic model of teacher competence to the specific context of teachers' promotion of self-regulated learning (SRL) in the classroom, and investigated teachers' competence profiles regarding SRL (study 1) and how teachers' competence can moderate the effectiveness of teacher training (study 2). In the first step, in study 1 191 teachers were assessed according to different characteristics that have been found to be important aspects of teacher competence (knowledge, beliefs, and self-efficacy). To investigate how these characteristics co-occur in teachers we determined latent profiles of teacher competence regarding SRL. To this end, and the data were subjected to a latent profile analysis that yielded two levels of competence profile: low and high competence to promote SRL. These competence profiles were positively associated with teachers' self-reported SRL practice in the classroom. Next, to test whether these competence profiles affect teachers' competence development, we conducted a training study. In this study 2, we examined the effects of an 8-h long teacher training about SRL on the development of teachers' competence (knowledge, beliefs, self-efficacy) and on their SRL practice in the classroom with a repeated measures control group design. Forty-five teachers participated in the training, and these teachers and their 543 students evaluated the effectiveness of the training. Training effects were found on the teacher level, but not on the student level. Teachers who participated in the training outperformed the control teachers in their development of self-efficacy to foster SRL, and their perceived SRL practice. Moreover, teachers' competence profiles moderated the training effect, showing that teachers with an initially high competence benefitted more from the training. Applying a generic model of teacher competence to the context of promoting SRL seems beneficial to inspire future research on indicators of teachers' SRL practice. (DIPF/Orig.)
DIPF-Departments: Lehr und Lernqualität in Bildungseinrichtungen
-
-
Author(s): Goldhammer, Frank; Hahnel, Carolin; Kroehne, Ulf; Zehner, Fabian
Title: From byproduct to design factor. On validating the interpretation of process indicators based on log data
In: Large-scale Assessments in Education, (2021) , S. 9:20
DOI: 10.1186/s40536-021-00113-5
URL: https://largescaleassessmentsineducation.springeropen.com/articles/10.1186/s40536-021-00113-5
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Leistungstest; Logdatei; PISA <Programme for International Student Assessment>; PIAAC <Programme for the International Assessment of Adult Competencies>; Datenanalyse; Interpretation; Leistungsmessung; Messverfahren; Indikator; Typologie; Testkonstruktion; Testtheorie
Abstract (english): International large-scale assessments such as PISA or PIAAC have started to provide public or scientific use files for log data; that is, events, event-related attributes and timestamps of test-takers' interactions with the assessment system. Log data and the process indicators derived from it can be used for many purposes. However, the intended uses and interpretations of process indicators require validation, which here means a theoretical and/or empirical justification that inferences about (latent) attributes of the test-taker's work process are valid. This article reviews and synthesizes measurement concepts from various areas, including the standard assessment paradigm, the continuous assessment approach, the evidence-centered design (ECD) framework, and test validation. Based on this synthesis, we address the questions of how to ensure the valid interpretation of process indicators by means of an evidence-centered design of the task situation, and how to empirically challenge the intended interpretation of process indicators by developing and implementing correlational and/or experimental validation strategies. For this purpose, we explicate the process of reasoning from log data to low-level features and process indicators as the outcome of evidence identification. In this process, contextualizing information from log data is essential in order to reduce interpretative ambiguities regarding the derived process indicators. Finally, we show that empirical validation strategies can be adapted from classical approaches investigating the nomothetic span and construct representation. Two worked examples illustrate possible validation strategies for the design phase of measurements and their empirical evaluation. (DIPF/Orig.)
DIPF-Departments: Lehr und Lernqualität in Bildungseinrichtungen
-
-
Author(s): Goldhammer, Frank; Kroehne, Ulf; Hahnel, Carolin; De Boeck, Paul
Title: Controlling speed in component skills of reading improves the explanation of reading comprehension
In: Journal of Educational Psychology, 113 (2021) 5, S. 861-878
DOI: 10.1037/edu0000655
URL: https://psycnet.apa.org/doi/10.1037/edu0000655
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Lesekompetenz; Fertigkeit; Kognitive Prozesse; Leistung; Antwort; Zeit; Wort; Semantik; Text; Leseverstehen; PISA <Programme for International Student Assessment>; Schüler; Messverfahren; Test; Experimentelle Untersuchung; Empirische Untersuchung; Deutschland
Abstract: Efficiency in reading component skills is crucial for reading comprehension, as efficient subprocesses do not extensively consume limited cognitive resources, making them available for comprehension processes. Cognitive efficiency is typically measured with speeded tests of relatively easy items. Observed responses and response times indicate the latent variables of ability and speed. Interpreting only ability or speed as efficiency may be misleading because there is a within-person dependency between both variables (speed-ability tradeoff [SAT]). Therefore, the present study measures efficiency as ability conditional on speed by controlling speed experimentally with item-level time limits. The proposed timed ability measures of reading component skills are expected to have a clearer interpretation in terms of efficiency and to be better predictors for reading comprehension. To support this claim, this study investigates two component skills, visual word recognition and sentence-level semantic integration (sentence reading), to understand how differences in ability in a timed condition are related to differences in ability and speed in a traditional untimed condition. Moreover, untimed and timed reading component skill measures were used to explain reading comprehension. A German subsample from Programme for International Student Assessment (PISA) 2012 completed the reading component skills tasks with and without item-level time limits and PISA reading tasks. The results showed that timed ability is only moderately related to untimed ability. Furthermore, timed ability measures proved to be stronger predictors of sentence-level and text-level reading comprehension than the corresponding untimed ability and speed measures, although using untimed ability and speed jointly as predictors increased the amount of explained variance.
Abstract (english): Efficiency in reading component skills is crucial for reading comprehension, as efficient subprocesses do not extensively consume limited cognitive resources, making them available for comprehension processes. Cognitive efficiency is typically measured with speeded tests of relatively easy items. Observed responses and response times indicate the latent variables of ability and speed. Interpreting only ability or speed as efficiency may be misleading because there is a within-person dependency between both variables (speed-ability tradeoff [SAT]). Therefore, the present study measures efficiency as ability conditional on speed by controlling speed experimentally with item-level time limits. The proposed timed ability measures of reading component skills are expected to have a clearer interpretation in terms of efficiency and to be better predictors for reading comprehension. To support this claim, this study investigates two component skills, visual word recognition and sentence-level semantic integration (sentence reading), to understand how differences in ability in a timed condition are related to differences in ability and speed in a traditional untimed condition. Moreover, untimed and timed reading component skill measures were used to explain reading comprehension. A German subsample from Programme for International Student Assessment (PISA) 2012 completed the reading component skills tasks with and without item-level time limits and PISA reading tasks. The results showed that timed ability is only moderately related to untimed ability. Furthermore, timed ability measures proved to be stronger predictors of sentence-level and text-level reading comprehension than the corresponding untimed ability and speed measures, although using untimed ability and speed jointly as predictors increased the amount of explained variance.
DIPF-Departments: Lehr und Lernqualität in Bildungseinrichtungen
-
-
Author(s): Hahnel, Carolin; Goldhammer, Frank; Kroehne, Ulf; Mahlow, Nina; Artelt, Cordula; Schoor, Cornelia
Title: Automated and controlled processes in comprehending multiple documents
In: Studies in Higher Education, 46 (2021) 10, S. 2074-2086
DOI: 10.1080/03075079.2021.1953333
URL: https://www.tandfonline.com/doi/full/10.1080/03075079.2021.1953333
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Beitrag in Sonderheft
Language: Englisch
Keywords: Student; Lesen; Dokument; Vielfalt; Informationsverarbeitung; Verhalten; Lesegeschwindigkeit; Kognitive Prozesse; Arbeitsgedächtnis; Leseverstehen; Kognitive Kompetenz; Test; Computerunterstütztes Verfahren; Datenanalyse; Empirische Untersuchung; Deutschland
Abstract: The study investigates automated and controlled cognitive processes that occur when university students read multiple documents (MDs). We examined data of 401 students dealing with two MD sets in a digital environment. Performance was assessed through several comprehension questions. Recorded log data gave indications about students' time allocation, corroboration, and sourcing. Independent measures were used for reading speed to tap the effects of automatic processing and for working memory and single-text reading comprehension to tap effects of controlled processing, with working memory considered the mental capacity for performing controlled processing. We found that faster readers completed the MD tasks faster and showed more corroboration behavior. At the same time, students skilled in comprehension allocated more time to processing MD tasks and were more likely to show MD-specific behaviors of corroboration and sourcing. Students' success in MD tasks was predicted by reading speed and working memory, with the effect of working memory being mediated by single-text comprehension. Behavioral indicators contributed independently in predicting students' MD comprehension. Results suggest that reading MDs resembles a problem-solving situation where students need to engage in controlled, non-routine processing to build up a comprehensive representation of MDs and benefit from highly automated, lower-level reading processes. (DIPF/Orig.)
DIPF-Departments: Lehr und Lernqualität in Bildungseinrichtungen