Development of a Multidimensional Computerized Adaptive Test Based on the Bifactor Model

Autor/inn/en	Sahin, Murat Dogan; Gelbal, Selahattin
Titel	Development of a Multidimensional Computerized Adaptive Test Based on the Bifactor Model
Quelle	In: International Journal of Assessment Tools in Education, 7 (2020) 3, S.323-342 (20 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Zusatzinformation	ORCID (Sahin, Murat Dogan) ORCID (Gelbal, Selahattin)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	2148-7456
Schlagwörter	Adaptive Testing; Computer Assisted Testing; Language Tests; Language Proficiency; College Students; Test Construction; Item Banks; Item Response Theory; Test Items; Scores; English (Second Language); Grammar; Vocabulary; Foreign Countries; Turkey + Suchen Sie Ihr Suchwort? Language test; Sprachtest; Language skill; Language skills; Sprachkompetenz; Collegestudent; Testaufbau; Item-Response-Theorie; Test content; Testaufgabe; English as second language; English; Second Language; Englisch als Zweitsprache; Grammatik; Wortschatz; Ausland; Türkei
Abstract	The purpose of this study was to conduct a real-time multidimensional computerized adaptive test (MCAT) using data from a previous paper-pencil test (PPT) regarding the grammar and vocabulary dimensions of an end-of-term proficiency exam conducted on students in a preparatory class at a university. An item pool was established through four separate 50-item sets applied in four different semesters. The fit between unidimensional, multi-unidimensional and bifactor IRT models was compared during item calibration, with the bifactor model providing the best fit for all data sets. This was followed by a hybrid simulation for 36 conditions obtained using six item selection methods, two ability estimation methods and three termination rules. The statistics and graphs obtained indicate Drule item selection, maximum a posteriori (MAP) ability estimation and standard error termination rule as the best algorithm for the real-time MCAT application. With the minimum number of items to be administered determined as 10, the real-time application conducted on 99 examinees yielded an average number of items of 13.4. The PPT format proficiency exam consists of 50 items, leading to the conclusion that the examinees participating in the real-time MCAT are administered an average of 74.4% fewer items than the PPT. Additionally, 86 of the examinees answered between 10-13 items. The item pool use rate is 30%. Lastly, the correlation between the PPT scores and general trait scores of 32 examinees was calculated as 0.77. (As Provided).
Anmerkungen	International Journal of Assessment Tools in Education. Pamukkale University, Faculty of Education, Kinikli Campus, Denizli 20070, Turkey. e-mail: ijate.editor@gmail.com; Web site: https://ijate.net/index.php/ijate
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01