An Evaluation of Automatic Item Generation: A Case Study of Weak Theory Approach

Autor/inn/en	Fu, Yanyan; Choe, Edison M.; Lim, Hwanggyu; Choi, Jaehwa
Titel	An Evaluation of Automatic Item Generation: A Case Study of Weak Theory Approach
Quelle	In: Educational Measurement: Issues and Practice, 41 (2022) 4, S.10-22 (13 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0731-1745
DOI	10.1111/emip.12529
Schlagwörter	Test Items; Measurement; Psychometrics; Test Construction; Automation; Evaluation + Suchen Sie Ihr Suchwort? Test content; Testaufgabe; Messverfahren; Psychometry; Psychometrie; Testaufbau; Evaluierung
Abstract	This case study applied the "weak theory" of Automatic Item Generation (AIG) to generate isomorphic item instances (i.e., unique but psychometrically equivalent items) for a large-scale assessment. Three representative instances were selected from each item template (i.e., model) and pilot-tested. In addition, a new analytical framework, differential child item functioning (DCIF) analysis, based on the existing differential item functioning statistics, was applied to evaluate the psychometric equivalency of item instances within each template. The results showed that, out of 23 templates, nine successfully generated isomorphic instances, five required minor revisions to make them isomorphic, and the remaining templates required major modifications. The results and insights obtained from the AIG template development procedure may help item writers and psychometricians effectively develop and manage the templates that generate isomorphic instances. (As Provided).
Anmerkungen	Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01