-
-
Author(s): Blanke, Elisabeth S.; Neubauer, Andreas B.; Houben, Marlies; Erbas, Yasemine; Brose, Annette
Title: Why do my thoughts feel so bad? Getting at the reciprocal effects of rumination and negative affect using dynamic structural equation modeling
In: Emotion, 22 (2022) 8, S. 1773-1786
DOI: 10.1037/emo0000946
URL: https://doi.apa.org/record/2021-21139-001
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Belgien; Datenanalyse; Datenerfassung; Dauer; Denken; Depression; Deutschland; Einstellung <Psy>; Emotion; Emotionaler Zustand; Fragebogenerhebung; Kognitive Prozesse; Messung; Messverfahren; Psychische Vorgänge; Stimmung; Stress; Strukturgleichungsmodell; Student; Tagesablauf; Wirkung
Abstract: Rumination means to perseveratively think about one's negative feelings and problems. It is a response to affective distress that is often referred to as maladaptive emotion regulation. According to the response styles theory and control theory, rumination may further prolong and exacerbate affective distress. This means that rumination can be viewed as both an antecedent and an outcome of negative affect (NA), and vice versa. However, at the level of short-term dynamics, state rumination and NA have previously mainly been examined as two separate outcomes. To model the reciprocal within-person effects and hence, to match theoretical assumptions, we combined the two interrelated time series in one model using dynamic structural equation modeling (DSEM). Both effects (NA on subsequent rumination and rumination on subsequent NA) were modeled simultaneously while acknowledging the autoregressive nature of both states (inert properties). We used data from two experience sampling studies (NStudy 1 = 200 Belgian university students; NStudy 2 = 70 German university students). Participants were paged on smartphones several times a day (Study 1: 10; Study 2: 6) for several days (Study 1: 7; Study 2: 9-12). In both studies, we found evidence for reciprocal effects of NA and rumination, and both processes showed autoregressive relationships. Aside from central findings, higher levels of rumination were also associated with higher rumination inertia, pointing toward more habitual rumination also being associated with prolonged rumination. Together, using DSEM, we found reciprocal associations between rumination and NA, while providing new insights into the dynamics between the two processes. (DIPF/Orig.)
DIPF-Departments: Bildung und Entwicklung
-
-
Author(s): Persic-Beck, Lothar; Goldhammer, Frank; Kroehne, Ulf
Title: Disengaged response behavior when the response button is blocked. Evaluation of a micro-intervention
In: Frontiers in Psychology. Section Quantitative Psychology and Measurement, 13 (2022) , S. 954532
DOI: 10.3389/fpsyg.2022.954532
URL: https://www.frontiersin.org/articles/10.3389/fpsyg.2022.954532/full
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Antwort; Datenanalyse; Dauer; Effektivität; Einflussfaktor; Erwachsener; Evaluation; Frage; Intervention; Kompetenz; Leistungstest; Logdatei; Messung; Motivation; Technologiebasiertes Testen; Testkonstruktion; Validität; Verhalten; Verhaltensänderung
Abstract (english): In large-scale assessments, disengaged participants might rapidly guess on items or skip items, which can affect the score interpretation's validity. This study analyzes data from a linear computer-based assessment to evaluate a micro-intervention that blocked the possibility to respond for 2 s. The blocked response was implemented to prevent participants from accidental navigation and as a naive attempt to prevent rapid guesses and rapid omissions. The response process was analyzed by interpreting log event sequences within a finite-state machine approach. Responses were assigned to different response classes based on the event sequence. Additionally, post hoc methods for detecting rapid responses based on response time thresholds were applied to validate the classification. Rapid guesses and rapid omissions could be distinguished from accidental clicks by the log events following the micro-intervention. Results showed that the blocked response interfered with rapid responses but hardly led to behavioral changes. However, the blocked response could improve the post hoc detection of rapid responding by identifying responses that narrowly exceed time-bound thresholds. In an assessment context, it is desirable to prevent participants from accidentally skipping items, which in itself may lead to an increasing popularity of initially blocking responses. If, however, data from those assessments is analyzed for rapid responses, additional log data information should be considered.
DIPF-Departments: Lehr und Lernqualität in Bildungseinrichtungen
-
-
Author(s): Becker, Benjamin; Debeer, Dries; Weirich, Sebastian; Goldhammer, Frank
Title: On the speed sensitivity parameter in the lognormal model for response times. Implications for test assembly
In: Applied Psychological Measurement, 45 (2021) 6, S. 407-422
DOI: 10.1177/01466216211008530
URL: https://journals.sagepub.com/doi/abs/10.1177/01466216211008530
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Software; Technologiebasiertes Testen; Messverfahren; Item-Response-Theory; Leistungstest; Frage; Antwort; Dauer; Einflussfaktor; Testkonstruktion; Modell; Vergleich; Testtheorie; Simulation
Abstract: In high-stakes testing, often multiple test forms are used and a common time limit is enforced. Test fairness requires that ability estimates must not depend on the administration of a specific test form. Such a requirement may be violated if speededness differs between test forms. The impact of not taking speed sensitivity into account on the comparability of test forms regarding speededness and ability estimation was investigated. The lognormal measurement model for response times by van der Linden was compared with its extension by Klein Entink, van der Linden, and Fox, which includes a speed sensitivity parameter. An empirical data example was used to show that the extended model can fit the data better than the model without speed sensitivity parameters. A simulation was conducted, which showed that test forms with different average speed sensitivity yielded substantial different ability estimates for slow test takers, especially for test takers with high ability. Therefore, the use of the extended lognormal model for response times is recommended for the calibration of item pools in high-stakes testing situations. Limitations to the proposed approach and further research questions are discussed. (DIPF/Orig.)
Abstract (english): In high-stakes testing, often multiple test forms are used and a common time limit is enforced. Test fairness requires that ability estimates must not depend on the administration of a specific test form. Such a requirement may be violated if speededness differs between test forms. The impact of not taking speed sensitivity into account on the comparability of test forms regarding speededness and ability estimation was investigated. The lognormal measurement model for response times by van der Linden was compared with its extension by Klein Entink, van der Linden, and Fox, which includes a speed sensitivity parameter. An empirical data example was used to show that the extended model can fit the data better than the model without speed sensitivity parameters. A simulation was conducted, which showed that test forms with different average speed sensitivity yielded substantial different ability estimates for slow test takers, especially for test takers with high ability. Therefore, the use of the extended lognormal model for response times is recommended for the calibration of item pools in high-stakes testing situations. Limitations to the proposed approach and further research questions are discussed. (DIPF/Orig.)
DIPF-Departments: Lehr und Lernqualität in Bildungseinrichtungen
-
-
Author(s): Deribo, Tobias; Kröhne, Ulf; Goldhammer, Frank
Title: Model‐based treatment of rapid guessing
In: Journal of Educational Measurement, 58 (2021) 2, S. 281-303
DOI: 10.1111/jedm.12290
URL: https://onlinelibrary.wiley.com/doi/10.1111/jedm.12290?af=R
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Leistungstest; Testkonstruktion; Messverfahren; Computerunterstütztes Verfahren; Frage; Antwort; Verhalten; Dauer; Problemlösen; Modell; Student; Medienkompetenz; Item-Response-Theory; Multiple-Choice-Verfahren; Validität; Panel; Längsschnittuntersuchung
Abstract (english): The increased availability of time-related information as a result of computer-based assessment has enabled new ways to measure test-taking engagement. One of these ways is to distinguish between solution and rapid guessing behavior. Prior research has recommended response-level filtering to deal with rapid guessing. Response-level filtering can lead to parameter bias if rapid guessing depends on the measured trait or (un-)observed covariates. Therefore, a model based on Mislevy and Wu (1996) was applied to investigate the assumption of ignorable missing data underlying response-level filtering. The model allowed us to investigate different approaches to treating response-level filtered responses in a single framework through model parameterization. The study found that lower-ability test-takers tend to rapidly guess more frequently and are more likely to be unable to solve an item they guessed on, indicating a violation of the assumption of ignorable missing data underlying response-level filtering. Further ability estimation seemed sensitive to different approaches to treating response-level filtered responses. Moreover, model-based approaches exhibited better model fit and higher convergent validity evidence compared to more naïve treatments of rapid guessing. The results illustrate the need to thoroughly investigate the assumptions underlying specific treatments of rapid guessing as well as the need for robust methods. (DIPF/Orig.)
DIPF-Departments: Lehr und Lernqualität in Bildungseinrichtungen
-
-
Author(s): Huang, Manxia; Schmiedek, Florian; Habermas, Tilmann
Title: Only some attempts at meaning-making are successful. The role of change-relatedness and positive implications for the self
In: Journal of Personality, 89 (2021) 2, S. 175-187
DOI: 10.1111/jopy.12573
URL: https://onlinelibrary.wiley.com/doi/10.1111/jopy.12573
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Erwachsener; Eltern; Verlust; Trauer; Depression; Psychisches Trauma; Bewältigung; Biografie; Wandel; Akzeptanz; Bildungsbeteiligung; Dauer; Bildungsniveau; Einflussfaktor; Befragung; Fragebogen; China
Abstract: Objective: Although meaning making and specifically autobiographical reasoning are expected to relate to well-being, findings tend to be mixed. Attempts at meaning making do not always lead to meaning made. We aimed to disentangle these complex relationships and also explore the role of level of education.
Method: Ninety participants (mean age 36.73 years, SD = 7.27; 74.4% women, 25.6% men) who had experienced the loss of a parent through death, going missing, or Alzheimer's disease narrated this loss, a sad, a turning point, and a self-defining memory, and completed questionnaires assessing depression, trauma symptoms, and protracted grief. Three aspects of autobiographical reasoning (quantity, valence, and change-relatedness of self-event connections) were related to meaning made (sophistication of meaning making) and symptom level.
Results: Years of education correlated both with positive implications of autobiographical reasoning and with meaning made. The quantity, positivity, and change-relatedness of attempts at meaning making (self-event connections) predicted accomplished meaning made, and positivity alone predicted less prolonged grief.
Conclusions: Adapting the life story after a loss such that change of the self is acknowledged and positive change can be constructed helps finding meaning and lowering protracted grief. These changes in narrative identity are supported by more years of education. (DIPF/Orig.)
DIPF-Departments: Bildung und Entwicklung
-
-
Author(s): Kramer, Andrea C.; Neubauer, Andreas B.; Stoffel, Martin; Voss, Andreas; Ditzen, Beate
Title: Tomorrow's gonna suck. Today's stress anticipation predicts tomorrow's post-awakening cortisol increase
In: Psychoneuroendocrinology, 106 (2019) , S. 38-46
DOI: 10.1016/j.psyneuen.2019.03.024
URN: urn:nbn:de:0111-dipfdocs-174748
URL: http://www.dipfdocs.de/volltexte/2020/17474/pdf/Kramer_2019_tomorrows_gonna_suck_A.pdf
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Stress; Psychophysiologie; Prognose; Wirkung; Tagesablauf; Bewältigung; Psychische Vorgänge; Junger Erwachsener; Messung; Schlaf; Dauer; Neuropsychologie
Abstract (english): The cortisol awakening response (a rapid rise in cortisol concentration shortly after awakening) is hypothesized to prepare the organism to cope with upcoming demands, suggesting a key role for anticipatory stress in its regulation. Yet, no thorough test of this hypothesis incorporating temporal dynamics of the underlying processes has been conducted so far. To address this gap in the literature, the present study investigated the effects of anticipated stress for the next day (assessed in the evening) on an estimate of the cortisol awakening response (assessed in the following morning). In an ambulatory assessment paradigm, 42 participants (69% female; mean age = 22.8, range = 18-30 years) completed 5 consecutive days of assessments in their daily lives, collecting saliva samples at awakening and 30 minutes later. Using hierarchical linear modeling, associations with anticipatory stress were examined separately on the within- and between-person level. In line with our expectations, anticipatory stress predicted the post-awakening cortisol increase on the within-person level, implying an elevated cortisol rise on days for which more stress than usual had been anticipated. In contrast, on the between-person level higher average anticipatory stress did not predict an increased cortisol rise. Taken together, the findings confirm a key role of anticipatory stress in the regulation of the cortisol awakening response on the within-person level. (DIPF/Orig.)
DIPF-Departments: Bildung und Entwicklung
-
-
Author(s): Naumann, Alexander; Rieser, Svenja; Musow, Stephanie; Hochweber, Jan; Hartig, Johannes
Title: Sensitivity of test items to teaching quality
In: Learning and Instruction, 60 (2019) , S. 41-53
DOI: 10.1016/j.learninstruc.2018.11.002
URL: https://www.sciencedirect.com/science/article/pii/S0959475217307065?via%3Dihub
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Leistungstest; Testkonstruktion; Unterricht; Qualität; Einflussfaktor; Testauswertung; Grundschule; Naturwissenschaftlicher Unterricht; Aktives Lernen; Entdeckendes Lernen; Unterrichtsmethode; Wirkung; Messverfahren; Testaufgabe; Problemlösen; Grundschüler; Dauer; Antwort; Schwierigkeit; Datenanalyse; Interpretation; Quasi-Experiment; Deutschland
Abstract: Instructional sensitivity is the psychometric capacity of tests or single items of capturing effects of classroom instruction. Yet, current item sensitivity measures' relationship to (a) actual instruction and (b) overall test sensitivity is rather unclear. The present study aims at closing these gaps by investigating test and item sensitivity to teaching quality, reanalyzing data from a quasi-experimental intervention study in primary school science education (1026 students, 53 classes, Mage = 8.79 years, SDage = 0.49, 50% female). We examine (a) the correlation of item sensitivity measures and the potential for cognitive activation in class and (b) consequences for test score interpretation when assembling tests from items varying in their degree of sensitivity to cognitive activation. Our study (a) provides validity evidence that item sensitivity measures may be related to actual classroom instruction and (b) points out that inferences on teaching drawn from test scores may vary due to test composition. (DIPF/Orig.)
DIPF-Departments: Bildungsqualität und Evaluation
-
-
Author(s): Frey, Andreas; Spoden, Christian; Goldhammer, Frank; Wenzel, S. Franziska C.
Title: Response time-based treatment of omitted responses in computer-based testing
In: Behaviormetrika, 45 (2018) 2, S. 505-526
DOI: 10.1007/s41237-018-0073-9
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Beitrag in Sonderheft
Language: Englisch
Keywords: Methode; Technologiebasiertes Testen; Antwort; Dauer; Verhalten; Item-Response-Theory; Fehlende Daten; Datenanalyse; Testaufgabe; Typologie; Medienkompetenz; Schülerleistungstest; Testauswertung
Abstract: A new response time-based method for coding omitted item responses in computer-based testing is introduced and illustrated with empirical data. The new method is derived from the theory of missing data problems of Rubin and colleagues and embedded in an item response theory framework. Its basic idea is using item response times to statistically test for each individual item whether omitted responses are missing completely at random (MCAR) or missing due to a lack of ability and, thus, not at random (MNAR) with fixed type-1 and type-2 error levels. If the MCAR hypothesis is maintained, omitted responses are coded as not administered (NA), and as incorrect (0) otherwise. The empirical illustration draws from the responses given by N = 766 students to 70 items of a computer-based ICT skills test. The new method is compared with the two common deterministic methods of scoring omitted responses as 0 or as NA. In result, response time thresholds from 18 to 58 s were identified. With 61%, more omitted responses were recoded into 0 than into NA (39%). The differences in difficulty were larger when the new method was compared to deterministically scoring omitted responses as NA compared to scoring omitted responses as 0. The variances and reliabilities obtained under the three methods showed small differences. The paper concludes with a discussion of the practical relevance of the observed effect sizes, and with recommendations for the practical use of the new method as a method to be applied in the early stage of data processing. (DIPF/Orig.)
DIPF-Departments: Bildungsqualität und Evaluation
-
-
Author(s): Kroehne, Ulf; Goldhammer, Frank
Title: How to conceptualize, represent, and analyze log data from technology-based assessments? A generic framework and an application to questionnaire items
In: Behaviormetrika, 45 (2018) 2, S. 527-563
DOI: 10.1007/s41237-018-0063-y
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Beitrag in Sonderheft
Language: Englisch
Keywords: Bildungsforschung; Empirische Forschung; Logdatei; Datenanalyse; Technologiebasiertes Testen; PISA <Programme for International Student Assessment>; Fragebogen; Konzeption; Testkonstruktion; Daten; Typologie; Hardware; Antwort; Verhalten; Dauer; Interaktion; Mensch-Maschine-Kommunikation; Indikator
Abstract: Log data from educational assessments attract more and more attention and large-scale assessment programs have started providing log data as scientific use files. Such data generated as a by-product of computer-assisted data collection has been known as paradata in survey research. In this paper, we integrate log data from educational assessments into a taxonomy of paradata. To provide a generic framework for the analysis of log data, finite state machines are suggested. Beyond its computational value, the specific benefit of using finite state machines is achieved by separating platform-specific log events from the definition of indicators by states. Specifically, states represent filtered log data given a theoretical process model, and therefore, encode the information of log files selectively. The approach is empirically illustrated using log data of the context questionnaires of the Programme for International Student Assessment (PISA). We extracted item-level response time components from questionnaire items that were administered as item batteries with multiple questions on one screen and related them to the item responses. Finally, the taxonomy and the finite state machine approach are discussed with respect to the definition of complete log data, the verification of log data and the reproducibility of log data analyses. (DIPF/Orig.)
DIPF-Departments: Bildungsqualität und Evaluation
-
-
Author(s): Kuger, Susanne; Linberg, Tobias; Bäumer, Thomas; Struck, Olaf
Title: Digitale Lernumwelten
Published: Bamberg: Leibniz-Institut für Bildungsverläufe ; Nationales Bildungspanel, 2018
URL: https://www.neps-data.de/Portals/0/Survey Papers/SP_XXXII.pdf
Publication Type: 5. Arbeits- und Diskussionspapiere; Arbeits- und Diskussionspapier (keine besondere Kategorie)
Language: Deutsch
Keywords: Datenanalyse; Datenerfassung; Dauer; Digitale Medien; Erhebungsinstrument; Forschungsdesign; Fragebogen; Internet; Konzeption; Lehren; Lernen; Lernumgebung; Mediennutzung; Motivation; Panel; Verhalten
Abstract: Digitale Medien und Werkzeuge sind aus Beruf, Schule/Studium und Freizeit nicht mehr wegzudenken und nehmen daher für alle Teilnehmerinnen und Teilnehmer des Nationalen Bildungspanels einen immer wichtigeren Stellenwert ein. Durch ihre immer stärkere Interaktivität stellen digitale Medien und Werkzeuge daher vor allem auch eine wichtige Anregungsquelle für diejenigen Befragten dar, die sich nicht (mehr) in formalen Bildungskontexten befinden. Der Arbeitsbereich "Lernumwelten" konzipierte eine Rahmenvorstellung dessen, was in Bezug auf digitale Lernumwelten relevante Indikatoren der Bedingungen, Prozesse oder Lernergebnisse sein können und entwickelte und evaluierte Fragebogeninstrumente, auf Basis dieser Rahmenkonzeption. Das vorliegende Papier skizziert die theoretische Rahmenkonzeption, die diesem Modul zugrunde liegt, enthält die daraus entwickelten Operationalisierungen und berichtet die Ergebnisse der Haupterhebung B109. Längerfristiges Ziel ist es, dieses Modul in Verbindung mit Herangehensweisen anderer Arbeitsbereiche des NEPS auch in den Erhebungen weiterer Kohorten des Nationalen Bildungspanels einzusetzen und ggf. für die Nutzung in unterschiedlichen Alterstichproben zu adaptieren. (DIPF/Orig.)
DIPF-Departments: Bildungsqualität und Evaluation