-
-
Autor*innen: Begrich, Lukas; Kuger, Susanne; Klieme, Eckhard; Kunter, Mareike
Titel: At a first glance - how reliable and valid is the thin slices technique to assess instructional quality
In: Learning and Instruction, 74 (2021) , S. 101466
DOI: 10.1016/j.learninstruc.2021.101466
URL: https://www.sciencedirect.com/science/article/pii/S0959475221000256
Dokumenttyp: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Sprache: Englisch
Abstract: Various approaches of assessing instructional quality have emerged in educational research. In this article, we present two studies that apply the thin slices procedure, investigating the reliability and validity of the ratings of three dimensions of instructional quality based solely on the first impressions of untrained social observers. Thirty undergraduate students rated 30-s clips from English lessons (Study 1) and Math lessons (Study 2) regarding three quality dimensions. The findings suggest high reliability in these ratings. Multilevel confirmatory analyses suggested construct validity in terms of differentiation between the three dimensions of instructional quality. Finally, we found some overlap between the thin slices ratings of classroom management and constructive support with ratings of trained raters based on observations of full lessons, as well as students' ratings of these dimensions. We discuss these results with respect to the potential of first impressions of untrained observers to measure instructional quality.
Abstract (english): Various approaches of assessing instructional quality have emerged in educational research. In this article, we present two studies that apply the thin slices procedure, investigating the reliability and validity of the ratings of three dimensions of instructional quality based solely on the first impressions of untrained social observers. Thirty undergraduate students rated 30-s clips from English lessons (Study 1) and Math lessons (Study 2) regarding three quality dimensions. The findings suggest high reliability in these ratings. Multilevel confirmatory analyses suggested construct validity in terms of differentiation between the three dimensions of instructional quality. Finally, we found some overlap between the thin slices ratings of classroom management and constructive support with ratings of trained raters based on observations of full lessons, as well as students' ratings of these dimensions. We discuss these results with respect to the potential of first impressions of untrained observers to measure instructional quality.
DIPF-Abteilung: Lehr und Lernqualität in Bildungseinrichtungen