Dr. Carmen Köhler

Projects

• Item Fit – Statistical and Practical Significance of Item Misfit in Educational Testing
• MYSKILLS – Identifying professional competencies (BKE)

Curriculum Vitae

Since 01/2016

Research assistant at the department of Educational Measurement at the DIPF (Advisor: Johannes Hartig)

06/2015 – 08/2015

Internship at the Educational Testing Service (ETS), Princeton, NJ

2012 – 2015

PhD student; dissertation topic: "Isn’t Something Missing? Latent Variable Models Accounting for Item Nonresponse", Freie Universität Berlin (Advisors: Steffi Pohl & Claus H. Carstensen)

2012 – 2015

Research assistant in the research project “Modeling Missing Data in Competence Tests” of the Priority Programme “Education as a Lifelong Process” (founded by the German Research Foundation [DFG]; PO1655/1-1)

2011 – 2012

Tutor for statistics in SPSS im Fachbereich Psychologie der Universität Trier

2007 – 2012

Psychology Major, University of Trier

Research Interests

• Dealing with missing responses in large scale assessments
• Item Response Theory
• Hierarchical linear modeling (HLM) 
• Generalized linear models (GLM)

Teaching

Teaching

Workshops

Publications

• Publications (DIPF database of publications)

• List of publications (pdf)
  

Journal Articles

• Köhler, C., Hartig, J., & Naumann, A. (2021). Detecting Instructions Effects – Deciding Between Covariance Analytical and Change-Score Approach. Educational Psychology Review. Advance online publication. doi:https://doi.org/10.1007/s10648-020-09590-6
• Köhler, C., Robitzsch, A., Fährmann, K., von Davier, M., & Hartig, J. (2020). A semiparametric approach for item response function estimation to detect item misfit. British Journal of Mathematical and Statistical Psychology. Advance online publication. doi:10.1111/bmsp.12224
• Aditomo, A., & Köhler, C (2020). Do student ratings provide reliable and valid information about teaching quality at the school level? Evaluating measures of science teaching in PISA 2015. Educational Assessment, Evaluation and Accountability, 32, 275–310. https://doi.org/10.1007/s11092-020-09328-6
• Hartig, J., Köhler, C., & Naumann, A. (2020). Using a multilevel random item Rasch model to examine item difficulty variance between random groups. Psychological Test and Assessment Modeling, 20(1), 11–27.
• Köhler, C., Hartig, J., & Schmid, C. (2020). Deciding between the Covariance Analytical Approach and the Change-Score Approach in Two Wave Panel Data. Multivariate Behavioral Research. doi:10.1080/00273171.2020.1726723
• Köhler, C., Robitzsch, A., & Hartig, J. (2020). A bias corrected RMSD item fit statistic: An evaluation and comparison to alternatives. Journal of Educational and Behavioral Statistics, 45(3), 251–273. doi:10.3102/1076998619890566
• Köhler, C., Kuger, S., Naumann, A., & Hartig, J. (2020). Multilevel models for evaluating the effectiveness of teaching: Conceptual and methodological considerations. Zeitschrift für Pädagogik, 66(1), 197–209.
• Naumann, A., Kuger, S., Köhler, C., & Hochweber, J. (2020). Conceptual and Methodological Challenges for Detecting the Effectiveness of Learning and Instruction. Zeitschrift für Pädagogik, 66(1), 179–196.
• Buerger, S., Kroehne, U., Köhler, C., & Goldhammer, F. (2019). What makes the difference? The impact of item properties on mode effects in reading assessments. Studies in Educational Evaluation, 62, 1–9. doi:10.1016/j.stueduc.2019.04.005
• Köhler, C., Pohl, S., & Carstensen, C. H. (2017). Dealing with item nonresponse in large-scale cognitive assessments: The impact of missing data methods on estimated explanatory relationships. Journal of Educational Measurement, 54(4), 397–419. doi: 10.1111/jedm.12154
• Köhler, C., & Hartig, J. (2017). Practical significance of item misfit in low-stakes educational assessment. Applied Psychological Measurement, 41(5), 388-400. doi: 10.1177/0146621617692978
• Köhler, C., Pohl, S., & Carstensen, C. H. (2015). Investigating mechanisms for missing responses in competence tests. Psychological Test and Assessment Modeling, 57, 499-522.
• Köhler, C., Pohl, S., & Carstensen, C. H. (2015). Taking the missing propensity into account when estimating competence scores – Evaluation of IRT models for non-ignorable omissions. Educational and Psychological Measurement, 75, 850-874. doi: 10.1177/0013164414561785

Book Chapters

• Naumann, A., Köhler, C., & Hartig, J. (2021). Der Beitrag der Kompetenztheorie für die Fachdidaktiken. In: G. Weißeno & B. Ziegler (Eds.), Handbuch Geschichts- und Politikdidaktik. Springer VS: Wiesbaden. https://doi.org/10.1007/978-3-658-29673-5_4-1
• Praetorius, A.-K., Herbert, B., Decristan, J., & Köhler, C. (2020). Lernergebnisse und unterrichtliche Wirkungen (Learning outcomes and teaching effects). In J. Grünkorn, E. Klieme; A.-K. Praetorius & P. Schreyer (Eds.), Mathematikunterricht im internationalen Vergleich. Ergebnisse aus der TALIS-Videostudie Deutschland (pp. 31–35). Frankfurt am Main: DIPF.
• Köhler, C., & Hartig, J. (2020). Assessment im Kontext von Mehrsprachigkeit. In I. Gogolin, A. Hansen, P. Leseman, S. McMonagle & D. Rauch (Hrsg.), Handbuch zur Mehrsprachigkeit und Bildung (pp. 303-308). Heidelberg: Springer
• Köhler, C., & Hartig, J. (2020). Reliability and validity. In A. Kobayashi (Ed.), International Encyclopedia of Human Geography, 2e. Oxford: Elsevier. doi:10.1016/B978-0-08-102295-5.10421-4

Dissertation thesis

• Köhler, C. (2017). Isn’t something missing? Latent variable models accounting for item nonresponse. Ph.D. thesis, Freie Universität Berlin.

Diploma thesis

• Köhler, C. (2012). Kann das Rasch-Modell Abweichungen bei der Vorhersage von Psychotherapieverläufen erklären? Unpublished diploma thesis, University of Trier.

Selected Presentations

• Köhler, C. (2019, October). Detecting Item Misfit in Educational Testing. Invited guest lecture at the Centre for Educational Effectiveness and Evaluation, KU Leuven, Belgium.
• Köhler, C., Hartig, J., & Schmid, C. (2019, May). Deciding Between the Covariance Analytical Approach and the Change-Score Approach in Two Wave Panel Data. Invited guest lecture at the research colloquium of the IQB, Berlin, Germany.
• Köhler, C., Hartig, J., & Naumann, A. (2019, January). Estimation of Random Group DIF using Two- and Three-Level GLMMs. Invited presentation in the Symposium “Scales comparability in large scale cross‐country assessments” at the 5th Lisbon Economics and Statistics in Education (LESE) meeting, Lisbon, Portugal.
• Köhler, C., & Hartig, J. (2018, July). Multilevel Models for Evaluating the Effectiveness of Instruction: ANCOVA vs. Change-Score Approach. Presentation at the 8th European Congress of Methodology of the European Association of Methodology (EAM), Jena, Germany.
• Köhler, C. (2017, December). The Use of Item Response Theory in Educational Studies. Invited talk at the FPPW (Seminar at Faculty of Psychology and Pedagogical Sciences), Ghent, Belgium.
• Köhler, C., Robitzsch, A., & Hartig, J. (2017, July). A bias corrected RMSD item fit statistic: An evaluation and comparison to alternatives. Presentation at the International Meeting of the Psychometric Society (IMPS), Zürich, Switzerland.
• Köhler, C., & Hartig, J. (2016, July). Practical significance of item misfit in educational large-scale assessment studies. Presentation at the 7th European Congress of Methodology of the European Association of Methodology (EAM), Mallorca, Spain.
• Köhler, C., Pohl, S., & Carstensen, C. H. (2016, April). Latente Ansätze zum Umgang mit fehlenden Werten in Kompetenztestdaten. Presentation at the 12th conference of the Austrian Psychological Society (ÖGP), Innsbruck, Austria.
• Köhler, C., Gu, L., Ho, T.-H., & Zu, J. (2015, Juli). Issues of Applying Multidimensional Item Response Theory in Practice. Presentation at the Educational Testing Service (ETS) final internship meeting, Princeton, NJ.
• Köhler, C., Pohl, S., & Carstensen, C. H. (2014, December). Missing responses in competence tests. Presentation at the final conference of the first funding phase of the SPP1646 Priority Programme „Education as a lifelong process“, Bamberg, Germany.
• Köhler, C. (2014, September). Die Plage der fehlenden Werte. Science slam presentation at the 49th Congress of the German Society of Psychology, Bochum, Germany.
• Köhler, C., Pohl, S., & Carstensen, C. H. (2014, July). Investigating the mechanisms for missing responses in competence tests. Presentation at the 6th European Congress of Methodology of the European Association of Methodology (EAM), Utrecht, Netherlands.

Memberships

German Psychological Society (DGPs)