Dr. Carmen Köhler
Post-doc Researcher
Educational Measurement
Rostocker Straße 6
60323
Frankfurt am Main
Projects
- Item Fit – Statistical and Practical Significance of Item Misfit in Educational Testing
- MYSKILLS – Identifying professional competencies (BKE)
Curriculum Vitae
Since 01/2016 | Research assistant at the department of Educational Measurement at the DIPF (Advisor: Johannes Hartig) |
06/15 – 08/15 | Internship at the Educational Testing Service (ETS), Princeton, NJ |
2012 – 2015 | PhD student; dissertation topic: "Isn’t Something Missing? Latent Variable Models Accounting for Item Nonresponse", Freie Universität Berlin (Advisors: Steffi Pohl & Claus H. Carstensen) |
2012 – 2015 | Research assistant in the research project “Modeling Missing Data in Competence Tests” of the Priority Programme “Education as a Lifelong Process” (founded by the German Research Foundation [DFG]; PO1655/1-1) |
2011 – 2012 | Tutor for statistics in SPSS im Fachbereich Psychologie der Universität Trier |
2007 – 2012 | Psychology Major, University of Trier |
Research Interests
- Dealing with missing responses in large scale assessments
- Item Response Theory
- Hierarchical linear modeling (HLM)
- Generalized linear models (GLM)
Teaching
Teaching
WS 2020/2021 | Practical Course: „Statistics for Psychologists: Fundamentals" (Goethe University Frankfurt) |
SS 2020 |
Seminar „Research Methods and Evaluation II“ (Goethe University Frankfurt) |
WS 2019/2020 | Seminar „Fundamentals of Diagnostics“ (Goethe University Frankfurt) |
WS 2019/2020 | Practical Course „Statistics for Psychologists: Fundamentals“ (Goethe University Frankfurt) |
WS 2018/2019 | „Fundamentals of Diagnostics“ (Goethe University Frankfurt) |
WS 2018/2019 | Practical Course „Statistics for Psychologists: Fundamentals“ (Goethe University Frankfurt) |
WS 2017/2018 | Seminar „Fundamentals of Diagnostics“ (Goethe University Frankfurt) |
SS 2017 | Lecture „Statistics for Psychologists, Consolidation“ (Goethe University Frankfurt) |
SS 2014 | Seminar IRT-Models: Theory and application |
WS 2012/2013 | Seminar "Applied Statistics I" (University Bamberg) |
SS 2013 | Seminar "Applied Statistics II" (University Bamberg) |
Workshops
05/2020 |
Workshop „Einführung in die Item Response Theorie“ per video chat at the Center for Research on Education and School Development (IFS) at the TU Dortmund University, Germany |
09/2019 |
Workshop „Einführung in die Item Response Theorie mit R“ during the 2019 Method Week of the Method Center Social Sciences of the Goethe-University Frankfurt, Germany |
09/2019 | Workshop „Einführung in die Mehrebenenanalyse mit R“ in the Ed-Tech Research Forum 2019, Essen, Germany |
09/2019 | Workshop „Einführung in R“ in the Ed-Tech Research Forum 2019, Essen, Germany |
07/2019 | Workshop „Item-Response-Theorie zur Kompetenzmodellierung und Skalierung in den Bildungswissenschaften” at the Summer Academy 2019 of the Graduate Academy of Teacher Evaluation Colleges (graph), Karlsruhe, Germany |
03/2019 | Workshop „Item-Response-Modelle in R” at the IPN Winterschool 2019, Kiel, Germany |
03/2018 | Workshop „Multilevel Analyses in R” at the 26th Congress of the German Society for Educational Sciences (DGfE) 2018, Essen, Germany |
09/2017 | Workshop „Introduction to IRT” at the Institut for Educational Quality Improvement (IQB), Berlin, Germany |
01/2015 | Workshop „Introduction into Item Response Theory” at the International Centre for Higher Education Research (INCHER), Kassel, Germany |
Publications
-
Publications (DIPF database of publications)
-
List of publications (pdf)
Journal Articles
- Köhler, C., Robitzsch, A., Fährmann, K., von Davier, M., & Hartig, J. (in press). A semiparametric approach for item response function estimation to detect item misfit. British Journal of Mathematical and Statistical Psychology.
- Aditomo, A., & Köhler, C (2020). Do student ratings provide reliable and valid information about teaching quality at the school level? Evaluating measures of science teaching in PISA 2015. Educational Assessment, Evaluation and Accountability, 32, 275–310. https://doi.org/10.1007/s11092-020-09328-6
- Hartig, J., Köhler, C., & Naumann, A. (2020). Using a multilevel random item Rasch model to examine item difficulty variance between random groups. Psychological Test and Assessment Modeling, 20(1), 11–27.
- Köhler, C., Hartig, J., & Schmid, C. (2020). Deciding between the Covariance Analytical Approach and the Change-Score Approach in Two Wave Panel Data. Multivariate Behavioral Research. doi:10.1080/00273171.2020.1726723
- Köhler, C., Robitzsch, A., & Hartig, J. (2020). A bias corrected RMSD item fit statistic: An evaluation and comparison to alternatives. Journal of Educational and Behavioral Statistics, 45(3), 251–273. doi:10.3102/1076998619890566
- Köhler, C., Kuger, S., Naumann, A., & Hartig, J. (2020). Multilevel models for evaluating the effectiveness of teaching: Conceptual and methodological considerations. Zeitschrift für Pädagogik, 66(1), 197–209.
- Naumann, A., Kuger, S., Köhler, C., & Hochweber, J. (2020). Conceptual and Methodological Challenges for Detecting the Effectiveness of Learning and Instruction. Zeitschrift für Pädagogik, 66(1), 179–196.
- Buerger, S., Kroehne, U., Köhler, C., & Goldhammer, F. (2019). What makes the difference? The impact of item properties on mode effects in reading assessments. Studies in Educational Evaluation, 62, 1–9. doi:10.1016/j.stueduc.2019.04.005
- Köhler, C., Pohl, S., & Carstensen, C. H. (2017). Dealing with item nonresponse in large-scale cognitive assessments: The impact of missing data methods on estimated explanatory relationships. Journal of Educational Measurement, 54(4), 397–419. doi: 10.1111/jedm.12154
- Köhler, C., & Hartig, J. (2017). Practical significance of item misfit in low-stakes educational assessment. Applied Psychological Measurement, 41(5), 388-400. doi: 10.1177/0146621617692978
- Köhler, C., Pohl, S., & Carstensen, C. H. (2015). Investigating mechanisms for missing responses in competence tests. Psychological Test and Assessment Modeling, 57, 499-522.
- Köhler, C., Pohl, S., & Carstensen, C. H. (2015). Taking the missing propensity into account when estimating competence scores – Evaluation of IRT models for non-ignorable omissions. Educational and Psychological Measurement, 75, 850-874. doi: 10.1177/0013164414561785
Book Chapters
- Köhler, C., & Hartig, J. (in press). Mehrsprachigkeit in der Testdiagnostik. In I. Gogolin, A. Hansen, P. Leseman, S. McMonagle & D. Rauch (Hrsg.), Handbuch zur Mehrsprachigkeit und Bildung. Heidelberg: Springer.
- Köhler, C., & Hartig, J. (2020). Reliability and validity. In A. Kobayashi (Ed.), International Encyclopedia of Human Geography, 2e. Oxford: Elsevier. doi:10.1016/B978-0-08-102295-5.10421-4
Dissertation thesis
- Köhler, C. (2017). Isn’t something missing? Latent variable models accounting for item nonresponse. Ph.D. thesis, Freie Universität Berlin.
Diploma thesis
- Köhler, C. (2012). Kann das Rasch-Modell Abweichungen bei der Vorhersage von Psychotherapieverläufen erklären? Unpublished diploma thesis, University of Trier.
Selected Presentations
- Köhler, C. (2019, October). Detecting Item Misfit in Educational Testing. Invited guest lecture at the Centre for Educational Effectiveness and Evaluation, KU Leuven, Belgium.
- Köhler, C., Hartig, J., & Schmid, C. (2019, May). Deciding Between the Covariance Analytical Approach and the Change-Score Approach in Two Wave Panel Data. Invited guest lecture at the research colloquium of the IQB, Berlin, Germany.
- Köhler, C., Hartig, J., & Naumann, A. (2019, January). Estimation of Random Group DIF using Two- and Three-Level GLMMs. Invited presentation in the Symposium “Scales comparability in large scale cross‐country assessments” at the 5th Lisbon Economics and Statistics in Education (LESE) meeting, Lisbon, Portugal.
- Köhler, C., & Hartig, J. (2018, July). Multilevel Models for Evaluating the Effectiveness of Instruction: ANCOVA vs. Change-Score Approach. Presentation at the 8th European Congress of Methodology of the European Association of Methodology (EAM), Jena, Germany.
- Köhler, C. (2017, December). The Use of Item Response Theory in Educational Studies. Invited talk at the FPPW (Seminar at Faculty of Psychology and Pedagogical Sciences), Ghent, Belgium.
- Köhler, C., Robitzsch, A., & Hartig, J. (2017, July). A bias corrected RMSD item fit statistic: An evaluation and comparison to alternatives. Presentation at the International Meeting of the Psychometric Society (IMPS), Zürich, Switzerland.
- Köhler, C., & Hartig, J. (2016, July). Practical significance of item misfit in educational large-scale assessment studies. Presentation at the 7th European Congress of Methodology of the European Association of Methodology (EAM), Mallorca, Spain.
- Köhler, C., Pohl, S., & Carstensen, C. H. (2016, April). Latente Ansätze zum Umgang mit fehlenden Werten in Kompetenztestdaten. Presentation at the 12th conference of the Austrian Psychological Society (ÖGP), Innsbruck, Austria.
- Köhler, C., Gu, L., Ho, T.-H., & Zu, J. (2015, Juli). Issues of Applying Multidimensional Item Response Theory in Practice. Presentation at the Educational Testing Service (ETS) final internship meeting, Princeton, NJ.
- Köhler, C., Pohl, S., & Carstensen, C. H. (2014, December). Missing responses in competence tests. Presentation at the final conference of the first funding phase of the SPP1646 Priority Programme „Education as a lifelong process“, Bamberg, Germany.
- Köhler, C. (2014, September). Die Plage der fehlenden Werte. Science slam presentation at the 49th Congress of the German Society of Psychology, Bochum, Germany.
- Köhler, C., Pohl, S., & Carstensen, C. H. (2014, July). Investigating the mechanisms for missing responses in competence tests. Presentation at the 6th European Congress of Methodology of the European Association of Methodology (EAM), Utrecht, Netherlands.
Memberships
German Psychological Society (DGPs)
last modified
Jan 16, 2021