DIPF database of publications

Detailansicht Treffer

DIPF database of publications

Show results

Köhler, Carmen; Robitzsch, Alexander; Hartig, Johannes:

A bias corrected RMSD item fit statistic
An evaluation and comparison to alternatives

In: Journal of Educational and Behavioral Statistics, 45 (2020) 3 , 251-273

URL of full text:


Document type
3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)

Item-Response-Theory, Testkonstruktion, Modell, Frage, Antwort, Messverfahren, Statistische Methode, Evaluation, Vergleich, Bildungsforschung, Empirische Forschung

Testing whether items fit the assumptions of an item response theory model is an important step in evaluating a test. In the literature, numerous item fit statistics exist, many of which show severe limitations. The current study investigates the root mean squared deviation (RMSD) item fit statistic, which is used for evaluating item fit in various large-scale assessment studies. The three research questions of this study are (1) whether the empirical RMSD is an unbiased estimator of the population RMSD; (2) if this is not the case, whether this bias can be corrected; and (3) whether the test statistic provides an adequate significance test to detect misfitting items. Using simulation studies, it was found that the empirical RMSD is not an unbiased estimator of the population RMSD, and nonparametric bootstrapping falls short of entirely eliminating this bias. Using parametric bootstrapping, however, the RMSD can be used as a test statistic that outperforms the other approaches - infit and outfit, S1 X2 with respect to both Type I error rate and power. The empirical application showed that parametric bootstrapping of the RMSD results in rather conservative item fit decisions, which suggests more lenient cut-off criteria. (DIPF/Orig.)

Educational Quality and Evaluation