Estimating Classification Accuracy and Consistency Indices for Multiple Measures with the Simple Structure MIRT Model

Autor/inn/en	Park, Seohee; Kim, Kyung Yong; Lee, Won-Chan
Titel	Estimating Classification Accuracy and Consistency Indices for Multiple Measures with the Simple Structure MIRT Model
Quelle	In: Journal of Educational Measurement, 60 (2023) 1, S.106-125 (20 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Kim, Kyung Yong)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0022-0655
DOI	10.1111/jedm.12338
Schlagwörter	Testing; Computation; Classification; Accuracy; Item Response Theory; Evaluation Methods; Decision Making; Alternative Assessment + Suchen Sie Ihr Suchwort? Testdurchführung; Testen; Classification system; Klassifikation; Klassifikationssystem; Item-Response-Theorie; Decision-making; Entscheidungsfindung
Abstract	Multiple measures, such as multiple content domains or multiple types of performance, are used in various testing programs to classify examinees for screening or selection. Despite the popular usages of multiple measures, there is little research on classification consistency and accuracy of multiple measures. Accordingly, this study introduces an approach to estimate classification consistency and accuracy indices for multiple measures under four possible decision rules: (1) complementary, (2) conjunctive, (3) compensatory, and (4) pairwise combinations of the three. The current study uses the IRT-recursive-based approach with the simple-structure multidimensional IRT model (SS-MIRT) to estimate the classification consistency and accuracy for multiple measures. Theoretical formulations of the four decision rules with a binary decision (Pass/Fail) are presented. The estimation procedures are illustrated using an empirical data example based on SS-MIRT. In addition, this study applies the estimation procedures to the unidimensional IRT (UIRT) context, considering that UIRT is practically used more. This application shows that the proposed procedure of classification consistency and accuracy could be used with a UIRT model for individual measures as an alternative method of SS-MIRT. (As Provided).
Anmerkungen	Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01