Menü Überspringen
Contact
Deutsch
English
Not track
Data Protection
Search
Log in
DIPF News
Research
Infrastructures
Institute
Zurück
Contact
Deutsch
English
Not track
Data Protection
Search
Home
>
Research
>
Publications
>
Publications Data Base
Search results in the DIPF database of publications
Your query:
(Schlagwörter: "Antwort")
Advanced Search
Search term
Only Open Access
Search
Unselect matches
Select all matches
Export
100
items matching your search terms.
Show all details
Questionnaire development and design for international large-scale asessments (ILSAs) Current […]
Jude, Nina; Kuger, Susanne
Working Papers
| 2018
38276 Endnote
Author(s):
Jude, Nina; Kuger, Susanne
Title:
Questionnaire development and design for international large-scale asessments (ILSAs) Current practice, challenges, and recommendations
Published:
Washington; DC: National Academy of Education, 2018
URL:
http://naeducation.org/wp-content/uploads/2018/02/2018-Questionnaire-Design-for-ILSA_v02-1.pdf
Publication Type:
5. Arbeits- und Diskussionspapiere; Stellungnahme/Positionspapier
Language:
Englisch
Keywords:
Konzeption; Fragebogen; Bildungsforschung; Empirische Forschung; Indikator; Schülerleistung; Motivation; Messverfahren; Erhebungsinstrument; Computerunterstütztes Verfahren; Anpassung; Übersetzung; Sozioökonomische Lage; Heterogenität; Inklusion; Antwort; Fehlende Daten; Validität; Daten; Dokumentation; Vergleichsuntersuchung; Internationaler Vergleich
Abstract:
This paper summarizes the latest practices and research topics in questionnaire use for international large-scale assessments (ILSAs). We point to the most important aspects in questionnaire design and development for international studies and highlight current challenges for the cross-cultural measurement of context factors in education. Finally, we open the discussion for research and policy issues that might lead to recommendations concerning an improved usage of context questionnaires in future studies. While we provide insight into a range of different studies, many of our examples will focus on the Program for International Student Assessment (PISA), one of the best known ILSAs and our area of expertise. (DIPF/Orig.)
DIPF-Departments:
Bildungsqualität und Evaluation
Paper-based assessment of the effects of aging on response time in processing speed. A diffusion […]
Dirk, Judith; Kratzsch, Gesa Katharina; Prindle, John P.; Kröhne, Ulf; Goldhammer, Frank; […]
Journal Article
| In: Journal of Intelligence | 2017
37296 Endnote
Author(s):
Dirk, Judith; Kratzsch, Gesa Katharina; Prindle, John P.; Kröhne, Ulf; Goldhammer, Frank; Schmiedek, Florian
Title:
Paper-based assessment of the effects of aging on response time in processing speed. A diffusion model analysis
In:
Journal of Intelligence, 5 (2017) 2, S. 1-16
DOI:
10.3390/jintelligence5020012
URN:
urn:nbn:de:0111-dipfdocs-191786
URL:
http://www.dipfdocs.de/volltexte/2020/19178/pdf/jintelligence_2017_2_Dirk_et_al_Paper-based_assessment_of_the_effects_of_aging_on_response_time_A.pdf
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Englisch
Keywords:
Alter Mensch; Altern; Antwort; Deutschland; Empirische Untersuchung; Junger Erwachsener; Kognitionspsychologie; Leistung; Messung; Modell; Vergleichsuntersuchung; Zeit
Abstract:
The effects of aging on response time were examined in a paper-based lexical-decision experiment with younger (age 18-36) and older (age 64-75) adults, applying Ratcliff's diffusion model. Using digital pens allowed the paper-based assessment of response times for single items. Age differences previously reported by Ratcliff and colleagues in computer-based experiments were partly replicated: older adults responded more conservatively than younger adults and showed a slowing of their nondecision components of RT by 53 ms. The rates of evidence accumulation (drift rate) showed no age-related differences. Participants with a higher score in a vocabulary test also had higher drift rates. The experiment demonstrates the possibility to use formal processing models with paper-based tests. (DIPF/Orig.)
DIPF-Departments:
Bildung und Entwicklung; Bildungsqualität und Evaluation
Conditioning factors of test-taking engagement in PIAAC. An exploratory IRT modelling approach […]
Goldhammer, Frank; Martens, Thomas; Lüdtke, Oliver
Journal Article
| In: Large-scale Assessments in Education | 2017
37971 Endnote
Author(s):
Goldhammer, Frank; Martens, Thomas; Lüdtke, Oliver
Title:
Conditioning factors of test-taking engagement in PIAAC. An exploratory IRT modelling approach considering person and item characteristics
In:
Large-scale Assessments in Education, 5 (2017) , S. 18
DOI:
10.1186/s40536-017-0051-9
URL:
https://largescaleassessmentsineducation.springeropen.com/articles/10.1186/s40536-017-0051-9
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Beitrag in Sonderheft
Language:
Englisch
Keywords:
Antwort; Einflussfaktor; Erwachsener; Item-Response-Theory; Kanada; Längsschnittuntersuchung; Leistungstest; Lesekompetenz; Mathematische Kompetenz; Messung; Motivation; PIAAC (Programme for the International Assessment of Adult Competencies); Problemlösen; Selbstkonzept; Technologiebasiertes Testen; Verhalten
Abstract:
Background: A potential problem of low-stakes large-scale assessments such as the Programme for the International Assessment of Adult Competencies (PIAAC) is low test-taking engagement. The present study pursued two goals in order to better understand conditioning factors of test-taking disengagement: First, a model-based approach was used to investigate whether item indicators of disengagement constitute a continuous latent person variable by domain. Second, the effects of person and item characteristics were jointly tested using explanatory item response models. Methods: Analyses were based on the Canadian sample of Round 1 of the PIAAC, with N = 26,683 participants completing test items in the domains of literacy, numeracy, and problem solving. Binary item disengagement indicators were created by means of item response time thresholds. Results: The results showed that disengagement indicators define a latent dimension by domain. Disengagement increased with lower educational attainment, lower cognitive skills, and when the test language was not the participant's native language. Gender did not exert any effect on disengagement, while age had a positive effect for problem solving only. An item's location in the second of two assessment modules was positively related to disengagement, as was item difficulty. The latter effect was negatively moderated by cognitive skill, suggesting that poor test-takers are especially likely to disengage with more difficult items. Conclusions: The negative effect of cognitive skill, the positive effect of item difficulty, and their negative interaction effect support the assumption that disengagement is the outcome of individual expectations about success (informed disengagement). (DIPF/Orig.)
DIPF-Departments:
Bildungsqualität und Evaluation
Modeling individual response time effects between and within experimental speed conditions. A GLMM […]
Goldhammer, Frank; Steinwascher, Merle A.; Kroehne, Ulf; Naumann, Johannes
Journal Article
| In: British Journal of Mathematical and Statistical Psychology | 2017
37357 Endnote
Author(s):
Goldhammer, Frank; Steinwascher, Merle A.; Kroehne, Ulf; Naumann, Johannes
Title:
Modeling individual response time effects between and within experimental speed conditions. A GLMM approach for speeded tests
In:
British Journal of Mathematical and Statistical Psychology, 70 (2017) 2, S. 238-256
DOI:
10.1111/bmsp.12099
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Beitrag in Sonderheft
Language:
Englisch
Keywords:
Test; Testkonstruktion; Antwort; Dauer; Unterschied; Messverfahren; Entscheidung; Einflussfaktor; Fehler; Modell; Vergleich
Abstract:
Completing test items under multiple speed conditions avoids the performance measure being confounded with individual differences in the speed-accuracy compromise, and offers insights into the response process, that is, how response time relates to the probability of a correct response. This relation is traditionally represented by two conceptually different functions: the speed-accuracy trade-off function (SATF) across conditions relating the condition average response time to the condition average of accuracy, and the conditional accuracy function (CAF) within a condition describing accuracy conditional on response time. Using a generalized linear mixed modelling approach, we propose an item response modelling framework that is suitable for item response and response time data from experimental speed conditions. The proposed SATF and CAF model accommodates response time effects between conditions (i.e., person and item SATF slope) and within conditions (i.e., residual CAF slopes), captures person and item differences in these effects, and is suitable for measures with a strong speed component. Moreover, for a single condition a CAF model is proposed distinguishing person, item and residual CAF. The properties of the models are illustrated with an empirical example. (DIPF/Orig.)
DIPF-Departments:
Bildungsqualität und Evaluation
Extreme response style as a cultural response to climato-economic deprivation
He, Jia; Vliert, Evert van de; Vijver, Fons J. R. van de
Journal Article
| In: International Journal of Psychology | 2017
36603 Endnote
Author(s):
He, Jia; Vliert, Evert van de; Vijver, Fons J. R. van de
Title:
Extreme response style as a cultural response to climato-economic deprivation
In:
International Journal of Psychology, 52 (2017) S1, S. 67-71
DOI:
10.1002/ijop.12287
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Englisch
Keywords:
Klima; Wirkung; PISA <Programme for International Student Assessment>; Jugendlicher; Fragebogenerhebung; Befragung; Antwort; Meinung; Wohlstand; Armut; Kultureinfluss; Einstellung <Psy>; Internationaler Vergleich; Empirische Untersuchung; Regressionsanalyse; OECD-Länder; Welt
Abstract:
We investigated the effects of climato-economic harshness on extreme response style. Climato-economic theorising postulates that a more threatening climate in poorer countries, in contrast to countries with a more comforting climate and richer countries with a more challenging climate, triggers intolerance of ambiguity and uncertainty avoidance inherent to conservatism, in-group favouritism and autocracy. Scores of extreme response style at country level, a proxy of this cluster of cultural characteristics, were extracted from students' responses in the Programme for International Student Assessment to test the hypothesis. In a series of hierarchical regression analysis across 64 countries, cold demands, heat demands and GDP per capita showed a highly significant interaction effect on extreme response style, predicting in total 30.7% of the variance. Extreme response style was highest in poorer countries with higher climatic demands, and lowest in richer countries with lower climate demands. Implications are discussed. (DIPF/Orig.)
DIPF-Departments:
Bildungsqualität und Evaluation
Dealing with item nonresponse in large-scale cognitive assessments. The impact of missing data […]
Köhler, Carmen; Pohl, Steffi; Carstensen, Claus H.
Journal Article
| In: Journal of Educational Measurement | 2017
38004 Endnote
Author(s):
Köhler, Carmen; Pohl, Steffi; Carstensen, Claus H.
Title:
Dealing with item nonresponse in large-scale cognitive assessments. The impact of missing data methods on estimated explanatory relationships
In:
Journal of Educational Measurement, 54 (2017) 4, S. 397-419
DOI:
10.1111/jedm.12154
URN:
urn:nbn:de:0111-dipfdocs-174619
URL:
http://www.dipfdocs.de/volltexte/2019/17461/pdf/KoehlerPohlCarstensen2017_A.pdf
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Englisch
Keywords:
Datenanalyse; Schülerleistungstest; Leistungsmessung; Fehlende Daten; Fragebogen; Antwort; Wirkung; Messverfahren; PISA <Programme for International Student Assessment>; Panel; Lesekompetenz; Regression; Simulation
Abstract:
Competence data from low-stakes educational large-scale assessment studies allow for evaluating relationships between competencies and other variables. The impact of item-level nonresponse has not been investigated with regard to statistics that determine the size of these relationships (e.g., correlations, regression coefficients). Classical approaches such as ignoring missing values or treating them as incorrect are currently applied in many large-scale studies, while recent model-based approaches that can account for nonignorable nonresponse have been developed. Estimates of item and person parameters have been demonstrated to be biased for classical approaches when missing data are missing not at random (MNAR). In our study, we focus on parameter estimates of the structural model (i.e., the true regression coefficient when regressing competence on an explanatory variable), simulating data according to various missing data mechanisms. We found that model-based approaches and ignoring missing values performed well in retrieving regression coefficients even when we induced missing data that were MNAR. Treating missing values as incorrect responses can lead to substantial bias. We demonstrate the validity of our approach empirically and discuss the relevance of our results. (DIPF/Orig.)
DIPF-Departments:
Bildungsqualität und Evaluation
End-to-end non-factoid question answering with an interactive visualization of neural attention […]
Rücklé, Andreas; Gurevych, Iryna
Book Chapter
| Aus: Association for Computational Linguistics (Hrsg.): Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, Vancouver, Canada, July 30 - August 4, 2017: System demonstrations | Stroudsburg; PA: Association for Computational Linguistics | 2017
37876 Endnote
Author(s):
Rücklé, Andreas; Gurevych, Iryna
Title:
End-to-end non-factoid question answering with an interactive visualization of neural attention weights
In:
Association for Computational Linguistics (Hrsg.): Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, Vancouver, Canada, July 30 - August 4, 2017: System demonstrations, Stroudsburg; PA: Association for Computational Linguistics, 2017 , S. 19-24
DOI:
10.18653/v1/P17-4004
URL:
https://aclanthology.info/pdf/P/P17/P17-4004.pdf
Publication Type:
4. Beiträge in Sammelbänden; Tagungsband/Konferenzbeitrag/Proceedings
Language:
Englisch
Keywords:
Computerlinguistik; Aufmerksamkeit; Vernetzung; Modell; Struktur; Analyse; Visualisierung; Forschung; Frage; Antwort; Benutzeroberfläche
Abstract:
Advanced attention mechanisms are an important part of sucessful neural network approaches for non-factoid answer selection because they allow the models to focus on few important segments within rather long answer texts. Analyzing attention mechanisms is thus crucial for understanding strengths and weaknesses of particular models. We present an extensible, highly modular service architecture that enables the transformation of neural network models for non-factoid answer selection into fully featured end-to-end question answering systems. The primary objective of our system is to enable researchers a way to interactively explore and compare attention-based neural networks for answer selection. Our interactive user interface helps researchers to better understand the capabilities of the different approaches and can aid qualitative analyses. The source-code of our system is publicly available. (DIPF/Orig.)
DIPF-Departments:
Informationszentrum Bildung
Linking extreme response style to response processes. A cross-cultural mixed methods approach
Benitez, Isabel; He, Jia; van de Vijver, Fons J. R.; Padilla, José-Luis
Journal Article
| In: International Journal of Psychology | 2016
36604 Endnote
Author(s):
Benitez, Isabel; He, Jia; van de Vijver, Fons J. R.; Padilla, José-Luis
Title:
Linking extreme response style to response processes. A cross-cultural mixed methods approach
In:
International Journal of Psychology, 51 (2016) 6, S. 464-473
DOI:
10.1002/ijop.12379
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Englisch
Keywords:
Antwort; Interkultureller Vergleich; Internationaler Vergleich; Interview; Kognitionspsychologie; Niederlande; Qualitative Forschung; Quantitative Forschung; Spanien; Verhalten; Verstehen
Abstract:
The aim of this study is to contribute to a better understanding of extreme response style in cross-cultural research by integrating quantitative and qualitative evidence in a mixed methods design. In the quantitative phase, indexes of extreme response style, derived from quality of life measures from different international studies, were compared between Spain and the Netherlands. Results indicated that extreme responding was more common among Spanish than among Dutch in endorsement of items, but that the opposite was found for frequency scales including never as a response anchor. In the qualitative phase, cognitive interviews were conducted with 25 participants in each country. The integration of quantitative results and qualitative findings suggests that country differences in extreme response style may stem from various sources, including the more independent evaluation of each item by Dutch, the stronger connotations of never for Spanish and stronger emotions triggered by specific topics such as work satisfaction that was more strongly associated with insecurity for Spanish. It is concluded that the integration of quantitative and qualitative evidence can help to understand cross-cultural similarities and differences in extreme response style. (DIPF/Orig.)
DIPF-Departments:
Bildungsqualität und Evaluation
Response styles in factual items. Personal, contextual, and cultural correlates
He, Jia; van de Vijver, Fons J. R.
Journal Article
| In: International Journal of Psychology | 2016
36601 Endnote
Author(s):
He, Jia; van de Vijver, Fons J. R.
Title:
Response styles in factual items. Personal, contextual, and cultural correlates
In:
International Journal of Psychology, 51 (2016) 6, S. 445-452
DOI:
10.1002/ijop.12263
URN:
urn:nbn:de:0111-dipfdocs-193218
URL:
http://www.dipfdocs.de/volltexte/2020/19321/pdf/IJoP_2016_6_He_van_de_Vijver_Response_styles_in_factual_items_A.pdf
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Englisch
Keywords:
Antwort; Datenanalyse; Erwachsener; Interkultureller Vergleich; Internationaler Vergleich; Messung; PIAAC <Programme for the International Assessment of Adult Competencies>; Verhalten
Abstract:
This study investigated response styles in factual items and explored their associations with personal, contextual and cultural factors. Responses on various factual questions, cognitive tests and interviewers' observational data from a total of 152,514 respondents in 22 countries in the Programme for the International Assessment of Adult Competencies (PIAAC) were analysed. Indexes of extreme, midpoint and acquiescent response styles were extracted from Likert-scale and dichotomous responses of factual items. A general response style (GRS) with a positive loading of extreme response style and negative loadings of midpoint and acquiescent response styles was confirmed. This factor showed a similar cross-cultural patterning as another general factor from attitudinal and self-evaluative items of Likert scales in a previous study, which indicated the pervasiveness of response styles irrespective of types of survey items. In a multilevel analysis, the individual-level GRS was found to be negatively related to being male, educational level and literacy competency, and positively related to 3rd-person presence and background noise, and at country level negatively associated with socioeconomic development. Cross-level interactions were also found. Implications on the pervasiveness and nature of response styles are discussed. (DIPF/Orig.)
DIPF-Departments:
Bildungsqualität und Evaluation
Automatic coding of short text responses via clustering in educational assessment
Zehner, Fabian; Sälzer, Christine; Goldhammer, Frank
Journal Article
| In: Educational and Psychological Measurement | 2016
35473 Endnote
Author(s):
Zehner, Fabian; Sälzer, Christine; Goldhammer, Frank
Title:
Automatic coding of short text responses via clustering in educational assessment
In:
Educational and Psychological Measurement, 76 (2016) 2, S. 280-303
DOI:
10.1177/0013164415590022
URN:
urn:nbn:de:0111-pedocs-149795
URL:
https://nbn-resolving.org/urn:nbn:de:0111-pedocs-149795
Publication Type:
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language:
Englisch
Keywords:
Antwort; Automatisierung; Codierung; Computerlinguistik; Leistungstest; Methode; PISA <Programme for International Student Assessment>; Software; Technologiebasiertes Testen; Testkonstruktion
Abstract:
Automatic coding of short text responses opens new doors in assessment. We implemented and integrated baseline methods of natural language processing and statistical modelling by means of software components that are available under open licenses. The accuracy of automatic text coding is demonstrated by using data collected in the Programme for International Student Assessment (PISA) 2012 in Germany. Free text responses of 10 items with Formula responses in total were analyzed. We further examined the effect of different methods, parameter values, and sample sizes on performance of the implemented system. The system reached fair to good up to excellent agreement with human codings Formula Especially items that are solved by naming specific semantic concepts appeared properly coded. The system performed equally well with Formula and somewhat poorer but still acceptable down to Formula Based on our findings, we discuss potential innovations for assessment that are enabled by automatic coding of short text responses. (DIPF/Orig.)
DIPF-Departments:
Bildungsqualität und Evaluation
Unselect matches
Select all matches
Export
<
1
...
3
4
5
...
10
>
Show all
(100)