Menü Überspringen
Contact
Deutsch
English
Not track
Data Protection
Search
Log in
DIPF News
Research
Infrastructures
Institute
Zurück
Contact
Deutsch
English
Not track
Data Protection
Search
Home
>
Research
>
Publications
>
Publications Data Base
Search results in the DIPF database of publications
Your query:
(Schlagwörter: "Messung")
Advanced Search
Search term
Only Open Access
Search
Unselect matches
Select all matches
Export
446
items matching your search terms.
Show all details
Student, school, and country differences in sustained test-taking effort in the 2009 PISA reading […]
Debeer, Dries; Buchholz, Janine; Hartig, Johannes; Janssen, Rianne
Journal Article
| In: Journal of Educational and Behavioral Statistics | 2014
35151 Endnote
Author(s):
Debeer, Dries; Buchholz, Janine; Hartig, Johannes; Janssen, Rianne
Title:
Student, school, and country differences in sustained test-taking effort in the 2009 PISA reading assessment
In:
Journal of Educational and Behavioral Statistics, 39 (2014) 6, S. 502-523
URN:
urn:nbn:de:0111-pedocs-123507
URL:
http://nbn-resolving.org/urn:nbn:de:0111-pedocs-123507
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Englisch
Keywords:
Einflussfaktor; Internationaler Vergleich; Item-Response-Theory; Leistungsmessung; Leistungsmotivation; Leistungsversagen; Lesekompetenz; OECD-Länder; PISA <Programme for International Student Assessment>; Schule; Schüler; Schülerleistung; Schülerleistungstest; Selbsteinschätzung; Testaufgabe; Testkonstruktion; Validität
Abstract:
In this article, the change in examinee effort during an assessment, which we will refer to as persistence, is modeled as an effect of item position. A multilevel extension is proposed to analyze hierarchically structured data and decompose the individual differences in persistence. Data from the 2009 Program of International Student Achievement (PISA) reading assessment from N = 467,819 students from 65 countries are analyzed with the proposed model, and the results are compared across countries. A decrease in examinee effort during the PISA reading assessment was found consistently across countries, with individual differences within and between schools. Both the decrease and the individual differences are more pronounced in lower performing countries. Within schools, persistence is slightly negatively correlated with reading ability; but at the school level, this correlation is positive in most countries. The results of our analyses indicate that it is important to model and control examinee effort in low-stakes assessments. (DIPF/Orig.)
DIPF-Departments:
Bildungsqualität und Evaluation
Generalization of the worst performance rule across the lifespan
Fernandez, Sebastien; Fagot, Delphine; Dirk, Judith; Ribaupierre, Anik de
Journal Article
| In: Intelligence | 2014
34271 Endnote
Author(s):
Fernandez, Sebastien; Fagot, Delphine; Dirk, Judith; Ribaupierre, Anik de
Title:
Generalization of the worst performance rule across the lifespan
In:
Intelligence, 42 (2014) , S. 31-43
DOI:
10.1016/j.intell.2013.10.001
URN:
urn:nbn:de:0111-dipfdocs-180695
URL:
http://www.dipfdocs.de/volltexte/2020/18069/pdf/Dirk_2014_generalizationoftheworstperformanceruleacrossthelifespan_A.pdf
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Englisch
Keywords:
Empirische Untersuchung; Intelligenz; Intelligenzmessung; Junger Erwachsener; Kind; Kognitive Prozesse; Lebensalter; Leistungsfähigkeit; Leistungsschwäche; Reaktion; Regressionsanalyse; Senior; Test; Zeit
Abstract:
The worst performance rule (WPR) predicts that the slowest trials in reaction time (RT) tasks are more strongly related to intelligence than the fastest trials. To date, the WPR was observed mainly in young adults. The present study examined if the WPR holds not only in young adults but also in children and older adults in three kinds of RT tasks (simple RT, choice RT, and inhibition). Results showed that in each age group slowest and fastest trials were related to intelligence but the former correlated with intelligence to a greater extent than the latter. These results support the assumption that the WPR can be generalized across the lifespan.
DIPF-Departments:
Bildung und Entwicklung
Controlling individuals' time spent on task in speeded performance measures. Experimental time […]
Goldhammer, Frank; Kröhne, Ulf
Journal Article
| In: Applied Psychological Measurement | 2014
34278 Endnote
Author(s):
Goldhammer, Frank; Kröhne, Ulf
Title:
Controlling individuals' time spent on task in speeded performance measures. Experimental time limits, posterior time limits, and response time modeling
In:
Applied Psychological Measurement, 38 (2014) 4, S. 255-267
DOI:
10.1177/0146621613517164
URN:
urn:nbn:de:0111-pedocs-127839
URL:
https://nbn-resolving.org/urn:nbn:de:0111-pedocs-127839
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Englisch
Keywords:
Adaptives Testen; Deutschland; Empirische Untersuchung; Item-Response-Theory; Leistungsdruck; Leistungsmessung; Modell; Reliabilität; Schüler; Schülerleistung; Schuljahr 12; Technologiebasiertes Testen; Testaufgabe; Validität; Zeit
Abstract:
The speed-ability trade-off becomes a measurement problem if there is between-subject variation in the speed-ability compromise, as this may affect the comparability of ability estimates. To control individual speed differences, the response-signal (RS) paradigm was applied requiring an immediate response as soon as an acoustic signal is presented. A figural discrimination task and a word recognition task were completed both in an untimed condition allowing individual differences in time spent on task and in several timed conditions where the time available for item completion was limited using the RS paradigm. Thus, speed was manipulated by varying the available time between stimulus-onset and RS. A total of N = 205 high school students participated in the study. Results showed that across timed conditions with decreasing time on task, the ability level and ability variance decreased substantially. Ability correlations between timed conditions were high, whereas correlations between untimed and timed conditions were low. This finding suggested that ability differences being inconsistent to those found in the timed condition are due to individual differences in time on task in the untimed condition. To eliminate these differences, two ways were considered. First, untimed responses were recoded using two-tailed posterior time limits. As expected, correlations between timed and untimed conditions were increased. Second, the log-transformed item response times were included in the item response model, which led to even higher correlations between timed and untimed conditions. Validity and generalizability of the proposed testing procedure are discussed.
DIPF-Departments:
Bildungsqualität und Evaluation
Assessing students' understandings of biological models and their use in science to evaluate a […]
Grünkorn, Juliane; Upmeier zu Belzen, Annette; Krüger, Dirk
Journal Article
| In: International Journal of Science Education | 2014
34215 Endnote
Author(s):
Grünkorn, Juliane; Upmeier zu Belzen, Annette; Krüger, Dirk
Title:
Assessing students' understandings of biological models and their use in science to evaluate a theoretical framework
In:
International Journal of Science Education, 36 (2014) 10, S. 1651-1684
DOI:
10.1080/09500693.2013.873155
URN:
urn:nbn:de:0111-pedocs-189963
URL:
http://nbn-resolving.org/urn:nbn:de:0111-pedocs-189963
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Englisch
Keywords:
Biologieunterricht; Deutschland; Empirische Untersuchung; Evaluation; Gymnasium; Inhaltsanalyse; Leistungsmessung; Modell; Naturwissenschaftliche Kompetenz; Naturwissenschaftlicher Unterricht; Schüler; Schülerleistung; Schülerleistungstest; Sekundarbereich; Testauswertung; Testkonstruktion; Testtheorie; Verstehen
Abstract:
Research in the field of students' understandings of models and their use in science describes different frameworks concerning these understandings. Currently, there is no conjoint framework that combines these structures and so far, no investigation has focused on whether it reflects students' understandings sufficiently (empirical evaluation). Therefore, the purpose of this article is to present the results of an empirical evaluation of a conjoint theoretical framework. The theoretical framework integrates relevant research findings and comprises five aspects which are subdivided into three levels each: nature of models, multiple models, purpose of models, testing, and changing models. The study was conducted with a sample of 1,177 seventh to tenth graders (aged 11-19 years) using open-ended items. The data were analysed by identifying students' understandings of models (nature of models and multiple models) and their use in science (purpose of models, testing, and changing models), and comparing as well as assigning them to the content of the theoretical framework. A comprehensive category system of students' understandings was thus developed. Regarding the empirical evaluation, the students' understandings of the nature and the purpose of models were sufficiently described by the theoretical framework. Concerning the understandings of multiple, testing, and changing models, additional initial understandings (only one model possible, no testing of models, and no change of models) need to be considered. This conjoint and now empirically tested framework for students' understandings can provide a common basis for future science education research. Furthermore, evidence-based indications can be provided for teachers and their instructional practice.
DIPF-Departments:
Bildungsqualität und Evaluation
The application of international large-scale assessment on educational effectiveness research
Klieme, Eckhard; Hu, Yongmei; Peng, Pai
Journal Article
| In: Educational Research | 2014
35057 Endnote
Author(s):
Klieme, Eckhard; Hu, Yongmei; Peng, Pai
Title:
The application of international large-scale assessment on educational effectiveness research
In:
Educational Research, 2014 (2014) 3, S. 39-47
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Sonstiges
Keywords:
Bildungsforschung; Bildungspolitik; Bildungssystem; DESI <Deutsch-Englisch-Schülerleistung-International>; Deutschland; Effektivität; Forschungsdesign; Längsschnittuntersuchung; Leistungsmessung; PISA <Programme for International Student Assessment>; Schülerleistung; Vergleichsuntersuchung
Abstract:
Es handelt sich um eine gekürzte, leicht überarbeitete und ins Chinesische übertragene Version von Klieme, E. (2012): The Role of Lage-Scale Assessments in Research on Educational Effectiveness and School Development. In: von Davier, M; Gonzalez, E.; Kirsch, I. & Yamamoto, K. (Eds.). The Role of International Large-Scale Assessments: Perspectives from Technology, Economy, and Educational Research. (pp 115-148). Heidelberg: Springer. (DIPF/Autor)
DIPF-Departments:
Bildungsqualität und Evaluation
Constrained multidimensional adaptive testing without intermixing items from different dimensions
Kröhne, Ulf; Goldhammer, Frank; Partchev, Ivailo
Journal Article
| In: Psychological Test and Assessment Modeling | 2014
35165 Endnote
Author(s):
Kröhne, Ulf; Goldhammer, Frank; Partchev, Ivailo
Title:
Constrained multidimensional adaptive testing without intermixing items from different dimensions
In:
Psychological Test and Assessment Modeling, 56 (2014) 4, S. 348-367
URL:
http://www.psychologie-aktuell.com/fileadmin/download/ptam/4-2014_20141222/03_kroehne.pdf
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Englisch
Keywords:
Adaptives Testen; Algorithmus; Effizienz; Item-Response-Theory; Messung; Psychometrie; Reliabilität; Simulation; Test
Abstract:
Multidimensional adaptive testing (MAT) can improve the efficiency of measuring traits that are known to be highly correlated. Content balancing techniques can ensure that tests fulfill requirements with respect to content areas, such as the number of items from various dimensions (target rates). However, content balancing does not restrict the order in which items are selected from dimensions. If multiple dimensions are measured with MAT, intermixing items from different dimensions might invalidate properties of those items, which are known from calibration studies without mixed item content. To avoid this, the known correlations between traits can be used to increase efficiency of the ability estimation only without intermixing items from different dimensions. In this simulation study, MAT allowing items to be intermixed between dimensions is compared to Constrained MAT (CMAT) that does not allow intermixing items between dimensions for items with between-item multidimensionality. As expected, MAT achieved the greatest reliability for equal target rates; however, CMAT with items administered in a pre-specified order dimension by dimension was not disadvantageous for unequal target rates. (DIPF/Orig.)
DIPF-Departments:
Bildungsqualität und Evaluation
The impact of reading material's lexical accessibility on text fading effects in children's reading […]
Nagler, Telse; Lonnemann, Jan; Linkersdörfer, Janosch; Hasselhorn, Marcus; Lindberg, Sven
Journal Article
| In: Reading and Writing | 2014
33754 Endnote
Author(s):
Nagler, Telse; Lonnemann, Jan; Linkersdörfer, Janosch; Hasselhorn, Marcus; Lindberg, Sven
Title:
The impact of reading material's lexical accessibility on text fading effects in children's reading performance
In:
Reading and Writing, 27 (2014) 5, S. 841-853
DOI:
10.1007/s11145-013-9468-x
URN:
urn:nbn:de:0111-dipfdocs-192117
URL:
http://www.dipfdocs.de/volltexte/2020/19211/pdf/Read_Writ_2014_5_Nagler_et_al_The_impact_of_reading_materials_lexical_accessibility_A.pdf
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Englisch
Keywords:
Einflussfaktor; Kind; Lesegeschwindigkeit; Lesekompetenz; Lesetest; Leseverstehen; Messung; Schuljahr 03; Text
Abstract:
The acceleration phenomenon (AP) is defined by improvements in reading speed and reading comprehension, induced by an artificial text fading procedure corresponding to the previously determined fastest individual reading rate. Recent results, however, indicated that fading that is slower than the self-paced reading rate can produce comparable reading enhancements. As reading performance can be strongly influenced by the reading material, this study aimed at investigating to which extent reading enhancements induced by text fading depend on the reading material's characteristics. We confronted 39 German third graders with a previously utilized text fading procedure, which was slower than their self-paced reading rate. Included text varied regarding to the lexical accessibility (LA), representing how well information can be accessed from the mental lexicon. Children's reading rates increased statistically significant due to text fading for all LA levels. However, reading comprehension was sensitive to the text material's characteristics: Reading comprehension enhancements were observable for easily accessible reading material, but not for material with intermediate or difficult levels of LA. Material that was difficult to retrieve from the mental lexicon even resulted in reduced reading comprehension in the fading condition. Possible influences on immediate lexical access, the impact of working memory capacity and implications for future AP research are discussed.
DIPF-Departments:
Bildung und Entwicklung
Modeling instructional sensitivity using a longitudinal multilevel differential item functioning […]
Naumann, Alexander; Hochweber, Jan; Hartig, Johannes
Journal Article
| In: Journal of Educational Measurement | 2014
35094 Endnote
Author(s):
Naumann, Alexander; Hochweber, Jan; Hartig, Johannes
Title:
Modeling instructional sensitivity using a longitudinal multilevel differential item functioning approach
In:
Journal of Educational Measurement, 51 (2014) 4, S. 381-399
DOI:
10.1111/jedm.12051
URN:
urn:nbn:de:0111-dipfdocs-189977
URL:
http://www.dipfdocs.de/volltexte/2020/18997/pdf/Naumann_et_al_2014_Modeling_instructional_sensitivity_using_LML-DIF_A.pdf
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Englisch
Keywords:
Curriculum; DESI <Deutsch-Englisch-Schülerleistungen-International>; Grundschule; Itemanalyse; Längsschnittuntersuchung; Leistungsmessung; Leistungstest; Modell; Qualität; Schülerleistung; Sekundarbereich; Testkonstruktion; Unterricht; Validität; Wirkung
Abstract (english):
Students' performance in assessments is commonly attributed to more or less effective teaching. This implies that students' responses are significantly affected by instruction. However, the assumption that outcome measures indeed are instructionally sensitive is scarcely investigated empirically. In the present study, we propose a longitudinal multilevel-differential item functioning (DIF) model to combine two existing yet independent approaches to evaluate items' instructional sensitivity. The model permits for a more informative judgment of instructional sensitivity, allowing the distinction of global and differential sensitivity. Exemplarily, the model is applied to two empirical data sets, with classical indices (Pretest-Posttest Difference Index and posttest multilevel-DIF) computed for comparison. Results suggest that the approach works well in the application to empirical data, and may provide important information to test developers. (DIPF/Autor)
DIPF-Departments:
Bildungsqualität und Evaluation
Erfolgreiches Problemlösen in technologiereichen Umgebungen. Wechselwirkungen zwischen […]
Naumann, Johannes; Goldhammer, Frank; Rölke, Heiko; Stelter, Annette
Journal Article
| In: Zeitschrift für Pädagogische Psychologie | 2014
34960 Endnote
Author(s):
Naumann, Johannes; Goldhammer, Frank; Rölke, Heiko; Stelter, Annette
Title:
Erfolgreiches Problemlösen in technologiereichen Umgebungen. Wechselwirkungen zwischen Interaktionsschritten und Aufgabenanforderungen
In:
Zeitschrift für Pädagogische Psychologie, 28 (2014) 4, S. 193-203
DOI:
10.1024/1010-0652/a000134
URN:
urn:nbn:de:0111-pedocs-148308
URL:
http://nbn-resolving.org/urn:nbn:de:0111-pedocs-148308
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Beitrag in Sonderheft
Language:
Deutsch
Keywords:
Deutschland; Empirische Untersuchung; Erfolg; Erwachsener; Interaktion; Kanada; Kompetenz; Messung; PIAAC <Programme for the International Assessment of Adult Competencies>; Problemlösen; Prognose; Technologiebasiertes Testen; Testaufgabe; Training
Abstract:
Wir zeigen anhand von Feldtestdaten des "Programme for the International Assessment of Adult Competencies" (PIAAC) in Deutschland (N = 661) und Kanada (N = 411), dass sich der Erfolg beim Lösen Technologiebasierter Probleme aus der Anzahl der Interaktionen mit dem System vorhersagen lässt. Dabei war der Zusammenhang umgekehrt U-förmig. Optimale Lösungsraten resultierten bei einer überdurchschnittlichen Anzahl von Interaktionen. Weiterhin wurde der Zusammenhang durch Merkmale der Aufgabe moderiert. Es resultierte vor allem bei Aufgaben, die eine hohe Zahl von Navigationsschritten erfordern, ein stark positiver Zusammenhang. Entgegen den Erwartungen resultierte bei wohl definierten Aufgaben ein höherer Zusammenhang zwischen der Anzahl von Interaktionen und der Lösungsrate als bei schwach definierten Aufgaben. Die Ergebnisse aus der deutschen und kanadischen Stichprobe waren parallel. (DIPF/Orig.)
Abstract (english):
Using Field Trial data from the Programme for the International Assessment of Adult Competencies (PIAAC) from the German (N = 661) and Canadian (N = 411) Field Trials, we show that success in technology-based problem solving is predicted by the number of actions taken during problem solving. The association was reversely U-shaped. The probability of succeeding on a problem-solving task was highest at an above-average number of actions. The association between actions taken and problem solving was further moderated by task characteristics. Especially in tasks involving long navigation sequences a strong positive association between the number of actions and task success was obtained. Against expectations, the association of actions and probability of task success was higher in well-defined than in ill-defined tasks. Results for the German and the Canadian samples ran parallel. (DIPF/Orig.)
DIPF-Departments:
Bildungsqualität und Evaluation; Informationszentrum Bildung
On the validity and generality of transfer effects in cognitive training research
Noack, Hannes; Lövdén, Martin; Schmiedek, Florian
Journal Article
| In: Psychological Research | 2014
34971 Endnote
Author(s):
Noack, Hannes; Lövdén, Martin; Schmiedek, Florian
Title:
On the validity and generality of transfer effects in cognitive training research
In:
Psychological Research, 78 (2014) 6, S. 773-789
DOI:
10.1007/s00426-014-0564-6
URN:
urn:nbn:de:0111-pedocs-125189
URL:
http://nbn-resolving.org/urn:nbn:de:0111-pedocs-125189
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Englisch
Keywords:
Arbeitsgedächtnis; Evaluation; Forschungsstand; Kognition; Literaturbericht; Messung; Training; Transfer; Validität; Wirkung
Abstract:
Evaluation of training effectiveness is a longstanding problem of cognitive intervention research. The interpretation of transfer effects needs to meet two criteria, generality and specificity. We introduce each of the two, and suggest ways of implementing them. First, the scope of the construct of interest (e.g., working memory) defines the expected generality of transfer effects. Given that the constructs of interest are typically defined at the latent level, data analysis should also be conducted at the latent level. Second, transfer should be restricted to measures that are theoretically related to the trained construct. Hence, the construct of interest also determines the specificity of expected training effects; to test for specificity, study designs should aim at convergent and discriminant validity. We evaluate the recent cognitive training literature in relation to both criteria. We conclude that most studies do not use latent factors for transfer assessment, and do not test for convergent and discriminant validity. (DIPF/Orig.)
DIPF-Departments:
Bildung und Entwicklung
Unselect matches
Select all matches
Export
<
1
...
18
19
20
>
Show all
(446)