-
-
Autor*innen: Köhler, Carmen; Hartig, Johannes; Naumann, Alexander
Titel: Detecting instruction effects. Deciding between covariance analytical and change-score approach
In: Educational Psychology Review, 33 (2021) 3, S. 1191-1211
DOI: 10.1007/s10648-020-09590-6
URN: urn:nbn:de:0111-pedocs-252368
URL: https://nbn-resolving.org/urn:nbn:de:0111-pedocs-252368
Dokumenttyp: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Sprache: Englisch
Schlagwörter: Empirische Forschung; Unterricht; Wirkung; Unterrichtsforschung; Methode; Messverfahren; Lernerfolg; Variable; Prognose; Schüler; Unterstützung; Selbstwirksamkeit; Lehrer; Forschungsdesign; Datenanalyse; Modell
Abstract: The article focuses on estimating effects in nonrandomized studies with two outcome measurement occasions and one predictor variable. Given such a design, the analysis approach can be to include the measurement at the previous time point as a predictor in the regression model (ANCOVA), or to predict the change-score of the outcome variable (CHANGE). Researchers demonstrated that both approaches can result in different conclusions regarding the reported effect. Current recommendations on when to apply which approach are, in part, contradictory. In addition, they lack direct reference to the educational and instructional research contexts, since they do not consider latent variable models in which variables are measured without measurement error. This contribution assists researchers in making decisions regarding their analysis model. Using an underlying hypothetical data-generating model, we identify for which kind of data-generating scenario (i.e., under which assumptions) the defined true effect equals the estimated regression coefficients of the ANCOVA and the CHANGE approach. We give empirical examples from instructional research and discuss which approach is more appropriate, respectively. (DIPF/Orig.)
DIPF-Abteilung: Lehr und Lernqualität in Bildungseinrichtungen