Uncertainties in the Item Parameter Estimates and Robust Automated Test Assembly

Autor/inn/en	Veldkamp, Bernard P.; Matteucci, Mariagiulia; de Jong, Martijn G.
Titel	Uncertainties in the Item Parameter Estimates and Robust Automated Test Assembly
Quelle	In: Applied Psychological Measurement, 37 (2013) 2, S.123-139 (17 Seiten) PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0146-6216
DOI	10.1177/0146621612469825
Schlagwörter	Test Construction; Test Items; Item Banks; Automation; Item Response Theory; Computation; Statistical Analysis; Robustness (Statistics); Computer Assisted Testing; Adaptive Testing + Suchen Sie Ihr Suchwort? Testaufbau; Test content; Testaufgabe; Item-Response-Theorie; Statistische Analyse; Widerstandsfähigkeit
Abstract	Item response theory parameters have to be estimated, and because of the estimation process, they do have uncertainty in them. In most large-scale testing programs, the parameters are stored in item banks, and automated test assembly algorithms are applied to assemble operational test forms. These algorithms treat item parameters as fixed values, and uncertainty is not taken into account. As a consequence, resulting tests might be off target or less informative than expected. In this article, the process of parameter estimation is described to provide insight into the causes of uncertainty in the item parameters. The consequences of uncertainty are studied. Besides, an alternative automated test assembly algorithm is presented that is robust against uncertainties in the data. Several numerical examples demonstrate the performance of the robust test assembly algorithm, and illustrate the consequences of not taking this uncertainty into account. Finally, some recommendations about the use of robust test assembly and some directions for further research are given. (Contains 7 figures.) (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10