Dr. Carmen Köhler

Projects

• Item Fit – Statistical and Practical Significance of Item Misfit in Educational Testing
• MYSKILLS – Identifying professional competencies (BKE)

Curriculum Vitae

Since 01/2016	Research assistant at the department of Educational Measurement at the DIPF (Advisor: Johannes Hartig)
06/15 – 08/15	Internship at the Educational Testing Service (ETS), Princeton, NJ
2012 – 2015	PhD student; dissertation topic: "Isn’t Something Missing? Latent Variable Models Accounting for Item Nonresponse", Freie Universität Berlin (Advisors: Steffi Pohl & Claus H. Carstensen)
2012 – 2015	Research assistant in the research project “Modeling Missing Data in Competence Tests” of the Priority Programme “Education as a Lifelong Process” (founded by the German Research Foundation [DFG]; PO1655/1-1)
2011 – 2012	Tutor for statistics in SPSS im Fachbereich Psychologie der Universität Trier
2007 – 2012	Psychology Major, University of Trier

Research Interests

• Dealing with missing responses in large scale assessments
• Item Response Theory
• Hierarchical linear modeling (HLM) 
• Generalized linear models (GLM)

Teaching

Teaching

WS 2020/2021	Practical Course: „Statistics for Psychologists: Fundamentals" (Goethe University Frankfurt)
SS 2020	Seminar „Research Methods and Evaluation II“ (Goethe University Frankfurt)
WS 2019/2020	Seminar „Fundamentals of Diagnostics“ (Goethe University Frankfurt)
WS 2019/2020	Practical Course „Statistics for Psychologists: Fundamentals“ (Goethe University Frankfurt)
WS 2018/2019	„Fundamentals of Diagnostics“ (Goethe University Frankfurt)
WS 2018/2019	Practical Course „Statistics for Psychologists: Fundamentals“ (Goethe University Frankfurt)
WS 2017/2018	Seminar „Fundamentals of Diagnostics“ (Goethe University Frankfurt)
SS 2017	Lecture „Statistics for Psychologists, Consolidation“ (Goethe University Frankfurt)
SS 2014	Seminar IRT-Models: Theory and application
WS 2012/2013	Seminar "Applied Statistics I" (University Bamberg)
SS 2013	Seminar "Applied Statistics II" (University Bamberg)

Workshops

05/2020	Workshop „Einführung in die Item Response Theorie“ per video chat at the Center for Research on Education and School Development (IFS) at the TU Dortmund University, Germany
09/2019	Workshop „Einführung in die Item Response Theorie mit R“ during the 2019 Method Week of the Method Center Social Sciences of the Goethe-University Frankfurt, Germany
09/2019	Workshop „Einführung in die Mehrebenenanalyse mit R“ in the Ed-Tech Research Forum 2019, Essen, Germany
09/2019	Workshop „Einführung in R“ in the Ed-Tech Research Forum 2019, Essen, Germany
07/2019	Workshop „Item-Response-Theorie zur Kompetenzmodellierung und Skalierung in den Bildungswissenschaften” at the Summer Academy 2019 of the Graduate Academy of Teacher Evaluation Colleges (graph), Karlsruhe, Germany
03/2019	Workshop „Item-Response-Modelle in R” at the IPN Winterschool 2019, Kiel, Germany
03/2018	Workshop „Multilevel Analyses in R” at the 26th Congress of the German Society for Educational Sciences (DGfE) 2018, Essen, Germany
09/2017	Workshop „Introduction to IRT” at the Institut for Educational Quality Improvement (IQB), Berlin, Germany
01/2015	Workshop „Introduction into Item Response Theory” at the International Centre for Higher Education Research (INCHER), Kassel, Germany

Publications

• Publications (DIPF database of publications)

• List of publications (pdf)
  

Journal Articles

• Köhler, C., Hartig, J., & Naumann, A. (2021). Detecting Instructions Effects – Deciding Between Covariance Analytical and Change-Score Approach. Educational Psychology Review. Advance online publication. doi:https://doi.org/10.1007/s10648-020-09590-6
• Köhler, C., Robitzsch, A., Fährmann, K., von Davier, M., & Hartig, J. (2020). A semiparametric approach for item response function estimation to detect item misfit. British Journal of Mathematical and Statistical Psychology. Advance online publication. doi:10.1111/bmsp.12224
• Aditomo, A., & Köhler, C (2020). Do student ratings provide reliable and valid information about teaching quality at the school level? Evaluating measures of science teaching in PISA 2015. Educational Assessment, Evaluation and Accountability, 32, 275–310. https://doi.org/10.1007/s11092-020-09328-6
• Hartig, J., Köhler, C., & Naumann, A. (2020). Using a multilevel random item Rasch model to examine item difficulty variance between random groups. Psychological Test and Assessment Modeling, 20(1), 11–27.
• Köhler, C., Hartig, J., & Schmid, C. (2020). Deciding between the Covariance Analytical Approach and the Change-Score Approach in Two Wave Panel Data. Multivariate Behavioral Research. doi:10.1080/00273171.2020.1726723
• Köhler, C., Robitzsch, A., & Hartig, J. (2020). A bias corrected RMSD item fit statistic: An evaluation and comparison to alternatives. Journal of Educational and Behavioral Statistics, 45(3), 251–273. doi:10.3102/1076998619890566
• Köhler, C., Kuger, S., Naumann, A., & Hartig, J. (2020). Multilevel models for evaluating the effectiveness of teaching: Conceptual and methodological considerations. Zeitschrift für Pädagogik, 66(1), 197–209.
• Naumann, A., Kuger, S., Köhler, C., & Hochweber, J. (2020). Conceptual and Methodological Challenges for Detecting the Effectiveness of Learning and Instruction. Zeitschrift für Pädagogik, 66(1), 179–196.
• Buerger, S., Kroehne, U., Köhler, C., & Goldhammer, F. (2019). What makes the difference? The impact of item properties on mode effects in reading assessments. Studies in Educational Evaluation, 62, 1–9. doi:10.1016/j.stueduc.2019.04.005
• Köhler, C., Pohl, S., & Carstensen, C. H. (2017). Dealing with item nonresponse in large-scale cognitive assessments: The impact of missing data methods on estimated explanatory relationships. Journal of Educational Measurement, 54(4), 397–419. doi: 10.1111/jedm.12154
• Köhler, C., & Hartig, J. (2017). Practical significance of item misfit in low-stakes educational assessment. Applied Psychological Measurement, 41(5), 388-400. doi: 10.1177/0146621617692978
• Köhler, C., Pohl, S., & Carstensen, C. H. (2015). Investigating mechanisms for missing responses in competence tests. Psychological Test and Assessment Modeling, 57, 499-522.
• Köhler, C., Pohl, S., & Carstensen, C. H. (2015). Taking the missing propensity into account when estimating competence scores – Evaluation of IRT models for non-ignorable omissions. Educational and Psychological Measurement, 75, 850-874. doi: 10.1177/0013164414561785

Book Chapters

• Praetorius, A.-K., Herbert, B., Decristan, J., & Köhler, C. (2020). Lernergebnisse und unterrichtliche Wirkungen (Learning outcomes and teaching effects). In J. Grünkorn, E. Klieme; A.-K. Praetorius & P. Schreyer (Eds.), Mathematikunterricht im internationalen Vergleich. Ergebnisse aus der TALIS-Videostudie Deutschland (pp. 31–35). Frankfurt am Main: DIPF.
• Köhler, C., & Hartig, J. (in press). Mehrsprachigkeit in der Testdiagnostik. In I. Gogolin, A. Hansen, P. Leseman, S. McMonagle & D. Rauch (Hrsg.), Handbuch zur Mehrsprachigkeit und Bildung. Heidelberg: Springer.
• Köhler, C., & Hartig, J. (2020). Reliability and validity. In A. Kobayashi (Ed.), International Encyclopedia of Human Geography, 2e. Oxford: Elsevier. doi:10.1016/B978-0-08-102295-5.10421-4

Dissertation thesis

• Köhler, C. (2017). Isn’t something missing? Latent variable models accounting for item nonresponse. Ph.D. thesis, Freie Universität Berlin.

Diploma thesis

• Köhler, C. (2012). Kann das Rasch-Modell Abweichungen bei der Vorhersage von Psychotherapieverläufen erklären? Unpublished diploma thesis, University of Trier.

Selected Presentations

• Köhler, C. (2019, October). Detecting Item Misfit in Educational Testing. Invited guest lecture at the Centre for Educational Effectiveness and Evaluation, KU Leuven, Belgium.
• Köhler, C., Hartig, J., & Schmid, C. (2019, May). Deciding Between the Covariance Analytical Approach and the Change-Score Approach in Two Wave Panel Data. Invited guest lecture at the research colloquium of the IQB, Berlin, Germany.
• Köhler, C., Hartig, J., & Naumann, A. (2019, January). Estimation of Random Group DIF using Two- and Three-Level GLMMs. Invited presentation in the Symposium “Scales comparability in large scale cross‐country assessments” at the 5th Lisbon Economics and Statistics in Education (LESE) meeting, Lisbon, Portugal.
• Köhler, C., & Hartig, J. (2018, July). Multilevel Models for Evaluating the Effectiveness of Instruction: ANCOVA vs. Change-Score Approach. Presentation at the 8th European Congress of Methodology of the European Association of Methodology (EAM), Jena, Germany.
• Köhler, C. (2017, December). The Use of Item Response Theory in Educational Studies. Invited talk at the FPPW (Seminar at Faculty of Psychology and Pedagogical Sciences), Ghent, Belgium.
• Köhler, C., Robitzsch, A., & Hartig, J. (2017, July). A bias corrected RMSD item fit statistic: An evaluation and comparison to alternatives. Presentation at the International Meeting of the Psychometric Society (IMPS), Zürich, Switzerland.
• Köhler, C., & Hartig, J. (2016, July). Practical significance of item misfit in educational large-scale assessment studies. Presentation at the 7th European Congress of Methodology of the European Association of Methodology (EAM), Mallorca, Spain.
• Köhler, C., Pohl, S., & Carstensen, C. H. (2016, April). Latente Ansätze zum Umgang mit fehlenden Werten in Kompetenztestdaten. Presentation at the 12th conference of the Austrian Psychological Society (ÖGP), Innsbruck, Austria.
• Köhler, C., Gu, L., Ho, T.-H., & Zu, J. (2015, Juli). Issues of Applying Multidimensional Item Response Theory in Practice. Presentation at the Educational Testing Service (ETS) final internship meeting, Princeton, NJ.
• Köhler, C., Pohl, S., & Carstensen, C. H. (2014, December). Missing responses in competence tests. Presentation at the final conference of the first funding phase of the SPP1646 Priority Programme „Education as a lifelong process“, Bamberg, Germany.
• Köhler, C. (2014, September). Die Plage der fehlenden Werte. Science slam presentation at the 49th Congress of the German Society of Psychology, Bochum, Germany.
• Köhler, C., Pohl, S., & Carstensen, C. H. (2014, July). Investigating the mechanisms for missing responses in competence tests. Presentation at the 6th European Congress of Methodology of the European Association of Methodology (EAM), Utrecht, Netherlands.

Memberships

German Psychological Society (DGPs)