Search results in the DIPF database of publications

Your query:

(Schlagwörter: "Leistungstest")

IGLU 2021. Lesekompetenz von Grundschulkindern im internationalen Vergleich und im Trend über 20 […] McElvany, Nele; Lorenz, Ramona; Goldhammer, Frank; Schilcher, Anita; Stubbe, Tobias C. (Hrsg.) Compilation Book | Münster: Waxmann | 2023 43956 Endnote: Editor(s) McElvany, Nele; Lorenz, Ramona; Goldhammer, Frank; Schilcher, Anita; Stubbe, Tobias C.
Title: IGLU 2021. Lesekompetenz von Grundschulkindern im internationalen Vergleich und im Trend über 20 Jahre
Published: Münster: Waxmann, 2023
URL: https://www.waxmann.com/index.php?eID=download&buchnr=4700
Publication Type: 2. Herausgeberschaft; Sammelband (keine besondere Kategorie)
Language: Deutsch
Keywords: Bundesland; Curriculum; Deutschland; Differenzierung; Digitale Medien; Empirische Untersuchung; Erhebungsinstrument; Grundschule; Grundschüler; IGLU <Internationale Grundschul-Lese-Untersuchung>; Internationaler Vergleich; Junge; Klassenführung; Kognitive Aktivierung; Leistungsmessung; Lesekompetenz; Lesetest; Leseunterricht; Leseverhalten; Leseverstehen; Mädchen; Migrationshintergrund; Motivation; Schülerleistung; Schülerleistungstest; Schuljahr 04; Soziale Herkunft; Testdurchführung; Testkonstruktion; Validität; Wohlbefinden
Abstract: Lesekompetenz ist die zentrale Grundlage für das gesamte schulische sowie außerschulische Lernen, gesellschaftliche Teilhabe und den weiteren Lebensweg der Schülerinnen und Schüler. Sie ermöglicht es, Informationen aus schriftlichem Material zu entnehmen, Inhalte zu verknüpfen, Schlussfolgerungen zu ziehen und Inhalte, Quellen sowie Intentionen kritisch zu reflektieren. Seit nun 20 Jahren ermöglicht die Internationale Grundschul-Lese-Untersuchung (IGLU) die Beschreibung des Stands und der Bedingungsfaktoren der Schlüsselkompetenz Lesen am Ende der vierten Klassenstufe im internationalen Vergleich. Die Erhebung 2021 fand im Kontext besonderer Bedingungen statt: Es wurden Grundschulkinder in den Blick genommen, die etwas mehr als ein Jahr lang unter den Bedingungen der COVID-19-Pandemie-Schutzmaßnahmen beschult wurden. Erstmals können durch die kontinuierliche Studienteilnahme Deutschlands seit 2001 neben der wichtigen Kernfrage der internationalen Verortung der mittleren Lesekompetenz von Viertklässlerinnen und Viertklässlern in Deutschland Informationen zum Trend dieser Befunde für die Zeit von 20 Jahren dargestellt werden. Damit erlauben die Befunde von IGLU 2021 auch eine Antwort auf die drängende Frage, inwieweit es in Deutschland gelungen ist, die nach dem PISA-Schock 2000 durch die Kultusministerkonferenz formulierten Ziele für die Weiterentwicklung der Bildung in Deutschland zu erreichen. (DIPF/Orig.)
DIPF-Departments: Lehr und Lernqualität in Bildungseinrichtungen

Individually endorsed and socially shared normative beliefs on acculturation. Resources and risk […] Baumert, Jürgen; Jansen, Malte; Becker, Michael; Neumann, Marko; Köller, Olaf; Maaz, Kai Journal Article | In: Journal of Educational Psychology. | 2023 43370 Endnote: Author(s): Baumert, Jürgen; Jansen, Malte; Becker, Michael; Neumann, Marko; Köller, Olaf; Maaz, Kai
Title: Individually endorsed and socially shared normative beliefs on acculturation. Resources and risk factors for academic and psychosocial adjustment in mid-adolescence
In: Journal of Educational Psychology., 115 (2023) 4, S. 589-608
DOI: 10.1037/edu0000779
URL: https://psycnet.apa.org/record/2023-35375-001
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Akkulturation; Assimilation; Berlin; Bildungsaspiration; Deutschland; Einflussfaktor; Einstellung <Psy>; Emotionale Entwicklung; Fragebogenerhebung; Integrierte Sekundarschule; Jugendlicher; Längsschnittuntersuchung; Leistungstest; Lernerfolg; Migrationshintergrund; Motivation; Multikulturalität; Multivariate Analyse; Psychosoziale Fähigkeit; Schuljahr 09; Schuljahr 10; Segregation; Selbstwertgefühl; Soziale Anpassung; Soziale Ungleichheit; Überzeugung; Wirkung; Zufriedenheit
Abstract: This article examines the extent to which normative beliefs on acculturation constitute (a) individual resources and risk factors for adolescents facing developmental tasks and (b) institutional norms that define developmental milieus in secondary schools. To what extent do egalitarianism, multiculturalism, assimilationism, and segregationism help or hinder academic and psychosocial adjustment in mid-adolescence? We examined how both individually endorsed beliefs and socially shared beliefs at the 10th-grade cohort level relate to students' academic performance, educational and occupational aspirations, motivational and emotional attachment to school, self-esteem, and life satisfaction. Data came from a random sample of 15- to 17-year-olds in Berlin, Germany, assessed at the end of Grades 9 and 10 (N = 1,992). Multivariate analyses identified egalitarianism and multiculturalism as the most prevalent acculturation beliefs, forming a combined belief pattern that pairs recognition of equality with respect for diversity. At the individual level, this belief pattern was positively related to academic and psychosocial adjustment. Assimilationism beliefs were associated with higher motivational and emotional attachment to school in both minority and majority students. Segregationism beliefs were associated with higher self-esteem in all adolescents regardless of background, but with lower levels of academic performance in immigrant youth. At the grade cohort level, a single bipolar factor (egalitarianism/multiculturalism vs. assimilationism/segregationism) described the institutional diversity culture. An environment characterized by egalitarianism/multiculturalism beliefs was positively associated with motivational and emotional attachment to school but not related to academic adjustment or psychological well-being. (DIPF/Orig.)
DIPF-Departments: Struktur und Steuerung des Bildungswesens

Changes in the speed-ability relation through different treatments of rapid guessing Deribo, Tobias; Goldhammer, Frank; Kröhne, Ulf Journal Article | In: Educational and Psychological Measurement | 2023 42903 Endnote: Author(s): Deribo, Tobias; Goldhammer, Frank; Kröhne, Ulf
Title: Changes in the speed-ability relation through different treatments of rapid guessing
In: Educational and Psychological Measurement, 83 (2023) 3, S. 473-494
DOI: 10.1177/00131644221109490
URL: https://journals.sagepub.com/doi/10.1177/00131644221109490
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Antwort; Deutschland; Empirische Untersuchung; Fertigkeit; Informations- und Kommunikationstechnologie; Item-Response-Theory; Leistungstest; Modell; Panel; Psychometrie; Reliabilität; Student; Test; Validität; Verhalten; Zeit
Abstract (english): As researchers in the social sciences, we are often interested in studying not directly observable constructs through assessments and questionnaires. But even in a well-designed and well-implemented study, rapid-guessing behavior may occur. Under rapid-guessing behavior, a task is skimmed shortly but not read and engaged with in-depth. Hence, a response given under rapid-guessing behavior does bias constructs and relations of interest. Bias also appears reasonable for latent speed estimates obtained under rapid-guessing behavior, as well as the identified relation between speed and ability. This bias seems especially problematic considering that the relation between speed and ability has been shown to be able to improve precision in ability estimation. For this reason, we investigate if and how responses and response times obtained under rapid-guessing behavior affect the identified speed-ability relation and the precision of ability estimates in a joint model of speed and ability. Therefore, the study presents an empirical application that highlights a specific methodological problem resulting from rapid-guessing behavior. Here, we could show that different (non-)treatments of rapid guessing can lead to different conclusions about the underlying speed-ability relation. Furthermore, different rapid-guessing treatments led to wildly different conclusions about gains in precision through joint modeling. The results show the importance of taking rapid guessing into account when the psychometric use of response times is of interest. (DIPF/Orig.)
DIPF-Departments: Lehr und Lernqualität in Bildungseinrichtungen

Practical significance of item misfit and its manifestations in constructs assessed in large‑scale […] Fährmann, Katharina; Köhler, Carmen; Hartig, Johannes; Heine, Jörg‑Henrik Journal Article | In: Large-scale Assessments in Education | 2022 42893 Endnote: Author(s): Fährmann, Katharina; Köhler, Carmen; Hartig, Johannes; Heine, Jörg‑Henrik
Title: Practical significance of item misfit and its manifestations in constructs assessed in large‑scale studies
In: Large-scale Assessments in Education, 10 (2022) , S. 7
DOI: 10.1186/s40536‑022‑00124‑w
URL: https://largescaleassessmentsineducation.springeropen.com/articles/10.1186/s40536-022-00124-w
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Abstract (english): When scaling psychological tests with methods of item response theory it is necessary to investigate to what extent the responses correspond to the model predictions. In addition to the statistical evaluation of item misfit, the question arises as to its practical significance. Although item removal is undesirable for several reasons, its practical consequences are rarely investigated and focus mostly on main survey data with pre-selected items. In this paper, we identify criteria to evaluate practical significance and discuss them with respect to various types of assessments and their particular purposes. We then demonstrate the practical consequences of item misfit using two data examples from the German PISA 2018 field trial study: one with cognitive data and one with non-cognitive/metacognitive data. For the former, we scale the data under the GPCM with and without the inclusion of misfitting items, and investigate how this influences the trait distribution and the allocation to reading competency levels. For non-cognitive/metacognitive data, we explore the effect of excluding misfitting items on estimated gender differences. Our results indicate minor practical consequences for person allocation and no changes in the estimated gender-difference effects. (DIPF/Orig.)
DIPF-Departments: Lehr und Lernqualität in Bildungseinrichtungen

Disengaged response behavior when the response button is blocked. Evaluation of a micro-intervention Persic-Beck, Lothar; Goldhammer, Frank; Kroehne, Ulf Journal Article | In: Frontiers in Psychology. Section Quantitative Psychology and Measurement | 2022 43065 Endnote: Author(s): Persic-Beck, Lothar; Goldhammer, Frank; Kroehne, Ulf
Title: Disengaged response behavior when the response button is blocked. Evaluation of a micro-intervention
In: Frontiers in Psychology. Section Quantitative Psychology and Measurement, 13 (2022) , S. 954532
DOI: 10.3389/fpsyg.2022.954532
URL: https://www.frontiersin.org/articles/10.3389/fpsyg.2022.954532/full
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Antwort; Datenanalyse; Dauer; Effektivität; Einflussfaktor; Erwachsener; Evaluation; Frage; Intervention; Kompetenz; Leistungstest; Logdatei; Messung; Motivation; Technologiebasiertes Testen; Testkonstruktion; Validität; Verhalten; Verhaltensänderung
Abstract (english): In large-scale assessments, disengaged participants might rapidly guess on items or skip items, which can affect the score interpretation's validity. This study analyzes data from a linear computer-based assessment to evaluate a micro-intervention that blocked the possibility to respond for 2 s. The blocked response was implemented to prevent participants from accidental navigation and as a naive attempt to prevent rapid guesses and rapid omissions. The response process was analyzed by interpreting log event sequences within a finite-state machine approach. Responses were assigned to different response classes based on the event sequence. Additionally, post hoc methods for detecting rapid responses based on response time thresholds were applied to validate the classification. Rapid guesses and rapid omissions could be distinguished from accidental clicks by the log events following the micro-intervention. Results showed that the blocked response interfered with rapid responses but hardly led to behavioral changes. However, the blocked response could improve the post hoc detection of rapid responding by identifying responses that narrowly exceed time-bound thresholds. In an assessment context, it is desirable to prevent participants from accidentally skipping items, which in itself may lead to an increasing popularity of initially blocking responses. If, however, data from those assessments is analyzed for rapid responses, additional log data information should be considered.
DIPF-Departments: Lehr und Lernqualität in Bildungseinrichtungen

On the speed sensitivity parameter in the lognormal model for response times. Implications for test […] Becker, Benjamin; Debeer, Dries; Weirich, Sebastian; Goldhammer, Frank Journal Article | In: Applied Psychological Measurement | 2021 42009 Endnote: Author(s): Becker, Benjamin; Debeer, Dries; Weirich, Sebastian; Goldhammer, Frank
Title: On the speed sensitivity parameter in the lognormal model for response times. Implications for test assembly
In: Applied Psychological Measurement, 45 (2021) 6, S. 407-422
DOI: 10.1177/01466216211008530
URL: https://journals.sagepub.com/doi/abs/10.1177/01466216211008530
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Software; Technologiebasiertes Testen; Messverfahren; Item-Response-Theory; Leistungstest; Frage; Antwort; Dauer; Einflussfaktor; Testkonstruktion; Modell; Vergleich; Testtheorie; Simulation
Abstract: In high-stakes testing, often multiple test forms are used and a common time limit is enforced. Test fairness requires that ability estimates must not depend on the administration of a specific test form. Such a requirement may be violated if speededness differs between test forms. The impact of not taking speed sensitivity into account on the comparability of test forms regarding speededness and ability estimation was investigated. The lognormal measurement model for response times by van der Linden was compared with its extension by Klein Entink, van der Linden, and Fox, which includes a speed sensitivity parameter. An empirical data example was used to show that the extended model can fit the data better than the model without speed sensitivity parameters. A simulation was conducted, which showed that test forms with different average speed sensitivity yielded substantial different ability estimates for slow test takers, especially for test takers with high ability. Therefore, the use of the extended lognormal model for response times is recommended for the calibration of item pools in high-stakes testing situations. Limitations to the proposed approach and further research questions are discussed. (DIPF/Orig.)
Abstract (english): In high-stakes testing, often multiple test forms are used and a common time limit is enforced. Test fairness requires that ability estimates must not depend on the administration of a specific test form. Such a requirement may be violated if speededness differs between test forms. The impact of not taking speed sensitivity into account on the comparability of test forms regarding speededness and ability estimation was investigated. The lognormal measurement model for response times by van der Linden was compared with its extension by Klein Entink, van der Linden, and Fox, which includes a speed sensitivity parameter. An empirical data example was used to show that the extended model can fit the data better than the model without speed sensitivity parameters. A simulation was conducted, which showed that test forms with different average speed sensitivity yielded substantial different ability estimates for slow test takers, especially for test takers with high ability. Therefore, the use of the extended lognormal model for response times is recommended for the calibration of item pools in high-stakes testing situations. Limitations to the proposed approach and further research questions are discussed. (DIPF/Orig.)
DIPF-Departments: Lehr und Lernqualität in Bildungseinrichtungen

Model‐based treatment of rapid guessing Deribo, Tobias; Kröhne, Ulf; Goldhammer, Frank Journal Article | In: Journal of Educational Measurement | 2021 41271 Endnote: Author(s): Deribo, Tobias; Kröhne, Ulf; Goldhammer, Frank
Title: Model‐based treatment of rapid guessing
In: Journal of Educational Measurement, 58 (2021) 2, S. 281-303
DOI: 10.1111/jedm.12290
URL: https://onlinelibrary.wiley.com/doi/10.1111/jedm.12290?af=R
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Leistungstest; Testkonstruktion; Messverfahren; Computerunterstütztes Verfahren; Frage; Antwort; Verhalten; Dauer; Problemlösen; Modell; Student; Medienkompetenz; Item-Response-Theory; Multiple-Choice-Verfahren; Validität; Panel; Längsschnittuntersuchung
Abstract (english): The increased availability of time-related information as a result of computer-based assessment has enabled new ways to measure test-taking engagement. One of these ways is to distinguish between solution and rapid guessing behavior. Prior research has recommended response-level filtering to deal with rapid guessing. Response-level filtering can lead to parameter bias if rapid guessing depends on the measured trait or (un-)observed covariates. Therefore, a model based on Mislevy and Wu (1996) was applied to investigate the assumption of ignorable missing data underlying response-level filtering. The model allowed us to investigate different approaches to treating response-level filtered responses in a single framework through model parameterization. The study found that lower-ability test-takers tend to rapidly guess more frequently and are more likely to be unable to solve an item they guessed on, indicating a violation of the assumption of ignorable missing data underlying response-level filtering. Further ability estimation seemed sensitive to different approaches to treating response-level filtered responses. Moreover, model-based approaches exhibited better model fit and higher convergent validity evidence compared to more naïve treatments of rapid guessing. The results illustrate the need to thoroughly investigate the assumptions underlying specific treatments of rapid guessing as well as the need for robust methods. (DIPF/Orig.)
DIPF-Departments: Lehr und Lernqualität in Bildungseinrichtungen

From byproduct to design factor. On validating the interpretation of process indicators based on […] Goldhammer, Frank; Hahnel, Carolin; Kroehne, Ulf; Zehner, Fabian Journal Article | In: Large-scale Assessments in Education | 2021 41612 Endnote: Author(s): Goldhammer, Frank; Hahnel, Carolin; Kroehne, Ulf; Zehner, Fabian
Title: From byproduct to design factor. On validating the interpretation of process indicators based on log data
In: Large-scale Assessments in Education, 9 (2021) , S. 20
DOI: 10.1186/s40536-021-00113-5
URN: urn:nbn:de:0111-pedocs-250050
URL: https://nbn-resolving.org/urn:nbn:de:0111-pedocs-250050
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Leistungstest; Logdatei; PISA <Programme for International Student Assessment>; PIAAC <Programme for the International Assessment of Adult Competencies>; Datenanalyse; Interpretation; Leistungsmessung; Messverfahren; Indikator; Typologie; Testkonstruktion; Testtheorie
Abstract (english): International large-scale assessments such as PISA or PIAAC have started to provide public or scientific use files for log data; that is, events, event-related attributes and timestamps of test-takers' interactions with the assessment system. Log data and the process indicators derived from it can be used for many purposes. However, the intended uses and interpretations of process indicators require validation, which here means a theoretical and/or empirical justification that inferences about (latent) attributes of the test-taker's work process are valid. This article reviews and synthesizes measurement concepts from various areas, including the standard assessment paradigm, the continuous assessment approach, the evidence-centered design (ECD) framework, and test validation. Based on this synthesis, we address the questions of how to ensure the valid interpretation of process indicators by means of an evidence-centered design of the task situation, and how to empirically challenge the intended interpretation of process indicators by developing and implementing correlational and/or experimental validation strategies. For this purpose, we explicate the process of reasoning from log data to low-level features and process indicators as the outcome of evidence identification. In this process, contextualizing information from log data is essential in order to reduce interpretative ambiguities regarding the derived process indicators. Finally, we show that empirical validation strategies can be adapted from classical approaches investigating the nomothetic span and construct representation. Two worked examples illustrate possible validation strategies for the design phase of measurements and their empirical evaluation. (DIPF/Orig.)
DIPF-Departments: Lehr und Lernqualität in Bildungseinrichtungen

What matters when? Social and dimensional comparisons in the context of university major choice Keyserlingk, Luise von; Dicke, Anna-Lena; Becker, Michael; Eccles, Jacquelynne J. Journal Article | In: AERA Open | 2021 42044 Endnote: Author(s): Keyserlingk, Luise von; Dicke, Anna-Lena; Becker, Michael; Eccles, Jacquelynne J.
Title: What matters when? Social and dimensional comparisons in the context of university major choice
In: AERA Open, 7 (2021)
DOI: 10.1177/23328584211020711
URN: urn:nbn:de:0111-pedocs-251726
URL: https://nbn-resolving.org/urn:nbn:de:0111-pedocs-251726
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Schüler; Student; Studienfach; Fächerwahl; Leistung; Vergleich; Standard; Fähigkeit; Selbstkonzept; Mathematik; Deutsch; Sekundarbereich; Schuljahr 12; Universität; Längsschnittuntersuchung; Leistungstest; Messung; Befragung; Datenanalyse; Strukturgleichungsmodell; Mehrebenenanalyse; Empirische Untersuchung; Deutschland
Abstract: Students compare their achievement to different standards in order to evaluate their ability. We built on the theoretical frameworks of situated expectancy-value theory, dimensional comparison theory, and the big-fish-little-pond effect literature to examine the role of social and dimensional comparisons for ability self-concept and subjective task value (STV) in secondary school and university major choice. We used two German longitudinal data sets from different cohorts with data collection in 12th grade and 2 years after high school graduation (Study 1: N = 2,207, Study 2: N = 1,710). Dimensional and social comparisons predicted students' self-concept and domain-specific STV in school: Individual achievement was positively related to ability self-concept and STV in the corresponding domain and negatively related in the noncorresponding domain. School-level mean achievement was negatively related to ability self-concept and STV in the corresponding domain. Dimensional comparisons were directly related to university major choice, social comparisons were only indirectly related. (DIPF/Orig.)
DIPF-Departments: Struktur und Steuerung des Bildungswesens

Soziale Herkunftseffekte in der Wahl der Hochschulform Bachsleitner, Anna Journal Article | In: Zeitschrift für Erziehungswissenschaft | 2020 40310 Endnote: Author(s): Bachsleitner, Anna
Title: Soziale Herkunftseffekte in der Wahl der Hochschulform
In: Zeitschrift für Erziehungswissenschaft, 23 (2020) 2, S. 394-425
DOI: 10.1007/s11618-020-00941-1
URN: urn:nbn:de:0111-pedocs-233093
URL: https://nbn-resolving.org/urn:nbn:de:0111-pedocs-233093
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Deutsch
Keywords: Hochschule; Universität; Fachhochschule; Berufsakademie; Übergang; Soziale Herkunft; Schülerleistung; Leistungstest; Schulabschluss; Studienwahl; Motiv <Psy>; Soziale Ungleichheit; Wirtschaftswissenschaft; Längsschnittuntersuchung; Multivariate Analyse; Regressionsanalyse; Empirische Untersuchung; Nordrhein-Westfalen; Berlin; Mecklenburg-Vorpommern; Sachsen-Anhalt; Deutschland
Abstract: Die vorliegende Studie untersucht, basierend auf der Längsschnittstudie BIJU, die in den Bundesländern Nordrhein-Westfalen, Berlin, Mecklenburg-Vorpommern und Sachsen-Anhalt durchgeführt wurde, soziale Herkunftseffekte bei der Wahl der Hochschulform zu Studienbeginn. Dabei liegt der Fokus auf den dahinter liegenden Mechanismen sozial ungleicher Übertritte an Universitäten, Fachhochschulen und Berufsakademien. Diese werden über primäre Effekte (herkunftsspezifische Unterschiede in Schulabschlussnoten und standardisierten Testleistungen), sekundäre Effekte in Form von Motiven der Ausbildungswahl und Aspekte des Ausbildungsweges modelliert. Die Ergebnisse zeigen, dass Studierende aus akademischem Elternhaus überdurchschnittlich häufig eine Universität und unterdurchschnittlich häufig eine Fachhochschule besuchen. Bei multivariater Betrachtung können Unterschiede in der Art der Studienberechtigung, einer Berufsausbildung, der Englischleistung sowie den Ausbildungswahlmotiven Herkunftseffekte zum Teil vermitteln. Die Befunde bleiben auch bei ausschließlicher Betrachtung einer Studiengruppe, die an allen Hochschulformen umfangreich vertreten ist, den Wirtschaftswissenschaften, stabil. (DIPF/Orig.)
DIPF-Departments: Struktur und Steuerung des Bildungswesens