Menü Überspringen
Contact
Deutsch
English
Not track
Data Protection
Search
Log in
DIPF News
Research
Infrastructures
Institute
Zurück
Contact
Deutsch
English
Not track
Data Protection
Search
Home
>
Research
>
Publications
>
Publications Data Base
Search results in the DIPF database of publications
Your query:
(Personen: "Goldhammer," und "Frank")
Advanced Search
Search term
Only Open Access
Search
Unselect matches
Select all matches
Export
134
items matching your search terms.
Show all details
Model‐based treatment of rapid guessing
Deribo, Tobias; Kröhne, Ulf; Goldhammer, Frank
Journal Article
| In: Journal of Educational Measurement | 2021
41271 Endnote
Author(s):
Deribo, Tobias; Kröhne, Ulf; Goldhammer, Frank
Title:
Model‐based treatment of rapid guessing
In:
Journal of Educational Measurement, 58 (2021) 2, S. 281-303
DOI:
10.1111/jedm.12290
URL:
https://onlinelibrary.wiley.com/doi/10.1111/jedm.12290?af=R
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Englisch
Keywords:
Leistungstest; Testkonstruktion; Messverfahren; Computerunterstütztes Verfahren; Frage; Antwort; Verhalten; Dauer; Problemlösen; Modell; Student; Medienkompetenz; Item-Response-Theory; Multiple-Choice-Verfahren; Validität; Panel; Längsschnittuntersuchung
Abstract (english):
The increased availability of time-related information as a result of computer-based assessment has enabled new ways to measure test-taking engagement. One of these ways is to distinguish between solution and rapid guessing behavior. Prior research has recommended response-level filtering to deal with rapid guessing. Response-level filtering can lead to parameter bias if rapid guessing depends on the measured trait or (un-)observed covariates. Therefore, a model based on Mislevy and Wu (1996) was applied to investigate the assumption of ignorable missing data underlying response-level filtering. The model allowed us to investigate different approaches to treating response-level filtered responses in a single framework through model parameterization. The study found that lower-ability test-takers tend to rapidly guess more frequently and are more likely to be unable to solve an item they guessed on, indicating a violation of the assumption of ignorable missing data underlying response-level filtering. Further ability estimation seemed sensitive to different approaches to treating response-level filtered responses. Moreover, model-based approaches exhibited better model fit and higher convergent validity evidence compared to more naïve treatments of rapid guessing. The results illustrate the need to thoroughly investigate the assumptions underlying specific treatments of rapid guessing as well as the need for robust methods. (DIPF/Orig.)
DIPF-Departments:
Lehr und Lernqualität in Bildungseinrichtungen
Separating PIAAC competencies from general cognitive skills. A dimensionality and explanatory […]
Engelhardt, Lena; Goldhammer, Frank; Lüdtke, Oliver; Köller, Olaf; Baumert, Jürgen; […]
Journal Article
| In: Studies in Educational Evaluation | 2021
41542 Endnote
Author(s):
Engelhardt, Lena; Goldhammer, Frank; Lüdtke, Oliver; Köller, Olaf; Baumert, Jürgen; Carstensen, Claus H.
Title:
Separating PIAAC competencies from general cognitive skills. A dimensionality and explanatory analysis
In:
Studies in Educational Evaluation, 71 (2021) , S. 101069
DOI:
10.1016/j.stueduc.2021.101069
URL:
https://www.sciencedirect.com/science/article/pii/S0191491X2100095X
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Englisch
Keywords:
PIAAC <Programme for the International Assessment of Adult Competencies>; Schreib- und Lesefähigkeit; Rechenkompetenz; Kognitive Kompetenz; Validität; Leistungsmessung; Test
Abstract:
This study aims to investigate how test scores from PIAAC (Programme for the International Assessment of Adult Competencies) can be interpreted, by comparing the PIAAC competencies literacy and numeracy to reasoning and perceptual speed. Dimensionality analyses supported, that the PIAAC competencies can be separated into a common factor overlapping with reasoning and perceptual speed, and domain-specific factors. For the common and specific factors, relations to other variables were analyzed. The nested factor for PIAAC literacy was as expected unrelated to age, positively related to learning opportunities during one's lifetime, and positively related to literacy skill use. The nested factor for PIAAC numeracy was also as expected unrelated to age, against expectation unrelated to learning opportunities during one's lifetime, and as expected positively related to numeracy skill use. Results support the validity of the intended test score interpretation for PIAAC literacy, while results for PIAAC numeracy were less clear. (DIPF/Orig.)
DIPF-Departments:
Lehr und Lernqualität in Bildungseinrichtungen
Development and evaluation of a framework for the performance-based testing of ICT skills
Engelhardt, Lena; Naumann, Johannes; Goldhammer, Frank; Frey, Andreas; Horz, Holger; Hartig, Katja; […]
Journal Article
| In: Frontiers in Education | 2021
41203 Endnote
Author(s):
Engelhardt, Lena; Naumann, Johannes; Goldhammer, Frank; Frey, Andreas; Horz, Holger; Hartig, Katja; Wenzel, S. Franziska C.
Title:
Development and evaluation of a framework for the performance-based testing of ICT skills
In:
Frontiers in Education, 6 (2021) , S. 668860
DOI:
10.3389/feduc.2021.668860
URL:
https://www.frontiersin.org/articles/10.3389/feduc.2021.668860/full
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Englisch
Keywords:
Informations- und Kommunikationstechnologie; Praktische Fertigkeit; Wissen; Problemlösen; Textverständnis; Bildverstehen; Bewertung; Modell; Item; Entwicklung; Testvalidität; Itemanalyse; Rasch-Modell; Implementation; Evaluation; Test; Testverhalten; Schüler; Sekundarstufe I; Baden-Württemberg; Rheinland-Pfalz; Deutschland
Abstract (english):
This paper addresses the development of performance-based assessment items for ICT skills, skills in dealing with information and communication technologies, a construct which is rather broadly and only operationally defined. Item development followed a construct-driven approach to ensure that test scores could be interpreted as intended. Specifically, ICT-specific knowledge as well as problem-solving and the comprehension of text and graphics were defined as components of ICT skills and cognitive ICT tasks (i.e., accessing, managing, integrating, evaluating, creating). In order to capture the construct in a valid way, design principles for constructing the simulation environment and response format were formulated. To empirically evaluate the very heterogeneous items and detect malfunctioning items, item difficulties were analyzed and behavior-related indicators with item-specific thresholds were developed and applied. The 69 item's difficulty scores from the Rasch model fell within a comparable range for each cognitive task. Process indicators addressing time use and test-taker interactions were used to analyze whether most test-takers executed the intended processes, exhibited disengagement, or got lost among the items. Most items were capable of eliciting the intended behavior; for the few exceptions, conclusions for item revisions were drawn. The results affirm the utility of the proposed framework for developing and implementing performance-based items to assess ICT skills. (DIPF/Orig.)
DIPF-Departments:
Lehr und Lernqualität in Bildungseinrichtungen
From byproduct to design factor. On validating the interpretation of process indicators based on […]
Goldhammer, Frank; Hahnel, Carolin; Kroehne, Ulf; Zehner, Fabian
Journal Article
| In: Large-scale Assessments in Education | 2021
41612 Endnote
Author(s):
Goldhammer, Frank; Hahnel, Carolin; Kroehne, Ulf; Zehner, Fabian
Title:
From byproduct to design factor. On validating the interpretation of process indicators based on log data
In:
Large-scale Assessments in Education, 9 (2021) , S. 20
DOI:
10.1186/s40536-021-00113-5
URN:
urn:nbn:de:0111-pedocs-250050
URL:
https://nbn-resolving.org/urn:nbn:de:0111-pedocs-250050
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Englisch
Keywords:
Leistungstest; Logdatei; PISA <Programme for International Student Assessment>; PIAAC <Programme for the International Assessment of Adult Competencies>; Datenanalyse; Interpretation; Leistungsmessung; Messverfahren; Indikator; Typologie; Testkonstruktion; Testtheorie
Abstract (english):
International large-scale assessments such as PISA or PIAAC have started to provide public or scientific use files for log data; that is, events, event-related attributes and timestamps of test-takers' interactions with the assessment system. Log data and the process indicators derived from it can be used for many purposes. However, the intended uses and interpretations of process indicators require validation, which here means a theoretical and/or empirical justification that inferences about (latent) attributes of the test-taker's work process are valid. This article reviews and synthesizes measurement concepts from various areas, including the standard assessment paradigm, the continuous assessment approach, the evidence-centered design (ECD) framework, and test validation. Based on this synthesis, we address the questions of how to ensure the valid interpretation of process indicators by means of an evidence-centered design of the task situation, and how to empirically challenge the intended interpretation of process indicators by developing and implementing correlational and/or experimental validation strategies. For this purpose, we explicate the process of reasoning from log data to low-level features and process indicators as the outcome of evidence identification. In this process, contextualizing information from log data is essential in order to reduce interpretative ambiguities regarding the derived process indicators. Finally, we show that empirical validation strategies can be adapted from classical approaches investigating the nomothetic span and construct representation. Two worked examples illustrate possible validation strategies for the design phase of measurements and their empirical evaluation. (DIPF/Orig.)
DIPF-Departments:
Lehr und Lernqualität in Bildungseinrichtungen
Controlling speed in component skills of reading improves the explanation of reading comprehension
Goldhammer, Frank; Kroehne, Ulf; Hahnel, Carolin; De Boeck, Paul
Journal Article
| In: Journal of Educational Psychology | 2021
41462 Endnote
Author(s):
Goldhammer, Frank; Kroehne, Ulf; Hahnel, Carolin; De Boeck, Paul
Title:
Controlling speed in component skills of reading improves the explanation of reading comprehension
In:
Journal of Educational Psychology, 113 (2021) 5, S. 861-878
DOI:
10.1037/edu0000655
URN:
urn:nbn:de:0111-pedocs-237977
URL:
https://nbn-resolving.org/urn:nbn:de:0111-pedocs-237977
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Englisch
Keywords:
Lesekompetenz; Fertigkeit; Kognitive Prozesse; Leistung; Antwort; Zeit; Wort; Semantik; Text; Leseverstehen; PISA <Programme for International Student Assessment>; Schüler; Messverfahren; Test; Experimentelle Untersuchung; Empirische Untersuchung; Deutschland
Abstract:
Efficiency in reading component skills is crucial for reading comprehension, as efficient subprocesses do not extensively consume limited cognitive resources, making them available for comprehension processes. Cognitive efficiency is typically measured with speeded tests of relatively easy items. Observed responses and response times indicate the latent variables of ability and speed. Interpreting only ability or speed as efficiency may be misleading because there is a within-person dependency between both variables (speed-ability tradeoff [SAT]). Therefore, the present study measures efficiency as ability conditional on speed by controlling speed experimentally with item-level time limits. The proposed timed ability measures of reading component skills are expected to have a clearer interpretation in terms of efficiency and to be better predictors for reading comprehension. To support this claim, this study investigates two component skills, visual word recognition and sentence-level semantic integration (sentence reading), to understand how differences in ability in a timed condition are related to differences in ability and speed in a traditional untimed condition. Moreover, untimed and timed reading component skill measures were used to explain reading comprehension. A German subsample from Programme for International Student Assessment (PISA) 2012 completed the reading component skills tasks with and without item-level time limits and PISA reading tasks. The results showed that timed ability is only moderately related to untimed ability. Furthermore, timed ability measures proved to be stronger predictors of sentence-level and text-level reading comprehension than the corresponding untimed ability and speed measures, although using untimed ability and speed jointly as predictors increased the amount of explained variance.
Abstract (english):
Efficiency in reading component skills is crucial for reading comprehension, as efficient subprocesses do not extensively consume limited cognitive resources, making them available for comprehension processes. Cognitive efficiency is typically measured with speeded tests of relatively easy items. Observed responses and response times indicate the latent variables of ability and speed. Interpreting only ability or speed as efficiency may be misleading because there is a within-person dependency between both variables (speed-ability tradeoff [SAT]). Therefore, the present study measures efficiency as ability conditional on speed by controlling speed experimentally with item-level time limits. The proposed timed ability measures of reading component skills are expected to have a clearer interpretation in terms of efficiency and to be better predictors for reading comprehension. To support this claim, this study investigates two component skills, visual word recognition and sentence-level semantic integration (sentence reading), to understand how differences in ability in a timed condition are related to differences in ability and speed in a traditional untimed condition. Moreover, untimed and timed reading component skill measures were used to explain reading comprehension. A German subsample from Programme for International Student Assessment (PISA) 2012 completed the reading component skills tasks with and without item-level time limits and PISA reading tasks. The results showed that timed ability is only moderately related to untimed ability. Furthermore, timed ability measures proved to be stronger predictors of sentence-level and text-level reading comprehension than the corresponding untimed ability and speed measures, although using untimed ability and speed jointly as predictors increased the amount of explained variance.
DIPF-Departments:
Lehr und Lernqualität in Bildungseinrichtungen
Automated and controlled processes in comprehending multiple documents
Hahnel, Carolin; Goldhammer, Frank; Kroehne, Ulf; Mahlow, Nina; Artelt, Cordula; Schoor, Cornelia
Journal Article
| In: Studies in Higher Education | 2021
41420 Endnote
Author(s):
Hahnel, Carolin; Goldhammer, Frank; Kroehne, Ulf; Mahlow, Nina; Artelt, Cordula; Schoor, Cornelia
Title:
Automated and controlled processes in comprehending multiple documents
In:
Studies in Higher Education, 46 (2021) 10, S. 2074-2086
DOI:
10.1080/03075079.2021.1953333
URN:
urn:nbn:de:0111-pedocs-243880
URL:
https://nbn-resolving.org/urn:nbn:de:0111-pedocs-243880
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Beitrag in Sonderheft
Language:
Englisch
Keywords:
Student; Lesen; Dokument; Vielfalt; Informationsverarbeitung; Verhalten; Lesegeschwindigkeit; Kognitive Prozesse; Arbeitsgedächtnis; Leseverstehen; Kognitive Kompetenz; Test; Computerunterstütztes Verfahren; Datenanalyse; Empirische Untersuchung; Deutschland
Abstract:
The study investigates automated and controlled cognitive processes that occur when university students read multiple documents (MDs). We examined data of 401 students dealing with two MD sets in a digital environment. Performance was assessed through several comprehension questions. Recorded log data gave indications about students' time allocation, corroboration, and sourcing. Independent measures were used for reading speed to tap the effects of automatic processing and for working memory and single-text reading comprehension to tap effects of controlled processing, with working memory considered the mental capacity for performing controlled processing. We found that faster readers completed the MD tasks faster and showed more corroboration behavior. At the same time, students skilled in comprehension allocated more time to processing MD tasks and were more likely to show MD-specific behaviors of corroboration and sourcing. Students' success in MD tasks was predicted by reading speed and working memory, with the effect of working memory being mediated by single-text comprehension. Behavioral indicators contributed independently in predicting students' MD comprehension. Results suggest that reading MDs resembles a problem-solving situation where students need to engage in controlled, non-routine processing to build up a comprehensive representation of MDs and benefit from highly automated, lower-level reading processes. (DIPF/Orig.)
DIPF-Departments:
Lehr und Lernqualität in Bildungseinrichtungen
Readers' perceived task demands and their relation to multiple document comprehension strategies […]
Schoor, Cornelia; Rouet, Jean-Francoise; Artelt, Cordula; Mahlow, Nina; Hahnel, Carolin; […]
Journal Article
| In: Learning and Individual Differences | 2021
41225 Endnote
Author(s):
Schoor, Cornelia; Rouet, Jean-Francoise; Artelt, Cordula; Mahlow, Nina; Hahnel, Carolin; Kroehne, Ulf; Goldhammer, Frank
Title:
Readers' perceived task demands and their relation to multiple document comprehension strategies and outcome
In:
Learning and Individual Differences, 88 (2021) , S. 102018
DOI:
10.1016/j.lindif.2021.102018
URL:
https://www.sciencedirect.com/science/article/abs/pii/S1041608021000558?via%3Dihub
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Englisch
DIPF-Departments:
Lehr und Lernqualität in Bildungseinrichtungen
Progressions in learning in the age of (mis)information (PLATO) Advances in higher education […]
Zlatkin-Troitschanskaia, Olga; Hartig, Johannes; Goldhammer, Frank
Journal Article
| In: Studies in Higher Education | 2021
42013 Endnote
Author(s):
Zlatkin-Troitschanskaia, Olga; Hartig, Johannes; Goldhammer, Frank
Title:
Progressions in learning in the age of (mis)information (PLATO) Advances in higher education learning research
In:
Studies in Higher Education, 46 (2021) 10, S. 1993-1995
DOI:
10.1080/03075079.2021.1953338
URL:
https://www.tandfonline.com/doi/abs/10.1080/03075079.2021.1953338?journalCode=cshe20
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Englisch
DIPF-Departments:
Lehr und Lernqualität in Bildungseinrichtungen
Students' online information use and learning progress in higher education. A critical literature […]
Zlatkin-Troitschanskaia, Olga; Hartig, Johannes; Goldhammer, Frank; Krstev, Jan
Journal Article
| In: Studies in Higher Education | 2021
42012 Endnote
Author(s):
Zlatkin-Troitschanskaia, Olga; Hartig, Johannes; Goldhammer, Frank; Krstev, Jan
Title:
Students' online information use and learning progress in higher education. A critical literature review
In:
Studies in Higher Education, 46 (2021) 10, S. 1996-2021
DOI:
10.1080/03075079.2021.1953336
URL:
https://www.tandfonline.com/doi/full/10.1080/03075079.2021.1953336
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Englisch
Abstract (english):
Learning using the Internet has become a vital factor for academic success in higher education. Students increasingly rely on the Internet as their main information source. However, related research is still an emerging and highly fragmented field. Therefore, this study aims to provide a comprehensive and integrative review of research literature on student learning vis-à-vis using the Internet. The review encompasses research on students' strategies for searching, evaluating, and selecting online information, the use of this information for domain-specific learning, and the influence of the characteristics of both online information sources and learners on searching, evaluating, and selecting online information. Moreover, research on how this information-related behavior develops and affects learning outcomes is considered. The literature research, conducted in 2020, employed the database Education Resources Information Center (ERIC) and the search engine Google Scholar. Based on relevant search phrases and keywords, over 500 publications were found. After a second search, 55 fitting publications from 2009 onwards were identified. The review reveals a lack of research on the characteristics of online information, how these characteristics affect student learning in higher education, and how student learning can be fostered by improving students' information-related strategies. Research integrating these different perspectives is even scarcer. (DIPF/Orig.)
DIPF-Departments:
Lehr und Lernqualität in Bildungseinrichtungen
Digitalisierung an Schulen - eine Bestandsaufnahme
Jude, Nina; Ziehm, Jeanette; Goldhammer, Frank; Drachsler, Hendrik; Hasselhorn, Marcus
Monograph
| Frankfurt am Main: DIPF | Leibniz‐Institut für Bildungsforschung und Bildungsinformation | 2020
40463 Endnote
Author(s):
Jude, Nina; Ziehm, Jeanette; Goldhammer, Frank; Drachsler, Hendrik; Hasselhorn, Marcus
Title:
Digitalisierung an Schulen - eine Bestandsaufnahme
Published:
Frankfurt am Main: DIPF | Leibniz‐Institut für Bildungsforschung und Bildungsinformation, 2020
URN:
urn:nbn:de:0111-pedocs-205226
URL:
https://www.pedocs.de/frontdoor.php?source_opus=20522
Publication Type:
1. Monographien (Autorenschaft); Monographie
Language:
Deutsch
Keywords:
Bestandsaufnahme; Bericht; Deutschland; Digitalisierung; Schule; Digitale Medien; Mediennutzung; Umsetzung; Klassenbuch; Elektronisches Buch; Lernprozess; Datenanalyse; Diagnostik; Computerunterstütztes Verfahren; Datenschutz; Bildungspolitik; Bildungsangebot; Infrastruktur; Medienausstattung
Abstract:
Die vorliegende Bestandsaufnahme ist das Ergebnis einer umfassenden Recherche zum Themenfeld Digitalisierung in Schulen im Jahr 2019. Die Recherche beinhaltete die Darstellung der aktuellen rechtlichen Lage in den Bundesländern vor dem Hintergrund des beschlossenen Digitalpaktes des Bundes, einschließlich der vorhandenen Ressourcen und erkannten Herausforderungen seitens der Bildungsverwaltung und der Schulen; eine Zusammenstellung national und international verfügbarer und eingesetzter Diagnoseinstrumente im Bereich der computerbasierten Lernverlaufsdiagnostik; eine Übersicht national und international erhältlicher Plattformen im Bereich der Schulverwaltung mit dem Schwerpunkt auf digitalen Klassenbüchern; aktuelle Erkenntnisse zu den Möglichkeiten von Learning Analytics sowie Erkenntnisse aus den entsprechenden Begleitforschungen. Diese Bestandsaufnahme dient der Sondierung der Entwicklung eines Infrastruktur- bzw. Plattformangebotes durch das DIPF und bildete die Grundlage für ein Fachgespräch mit Vertretenden der Bildungspraxis, Bildungsforschung und Bildungspolitik im Januar 2020. In diesem wurden die Herausforderungen und Möglichkeiten der Implementation eines Tools bzw. einer Plattform im Bereich Trusted Learning/Learning Analytics eruiert. (DIPF/Orig.)
DIPF-Departments:
Bildung und Entwicklung; Bildungsqualität und Evaluation; Informationszentrum Bildung
Unselect matches
Select all matches
Export
<
1
...
3
4
5
...
14
>
Show all
(134)