Technology-Enhanced Items and Model-Data Misfit. Research Report. ETS RR-22-11

Autor/inn/en	Eckerly, Carol; Jia, Yue; Jewsbury, Paul
Titel	Technology-Enhanced Items and Model-Data Misfit. Research Report. ETS RR-22-11
Quelle	In: ETS Research Report Series, (2022), (18 Seiten)Infoseite zur Zeitschrift PDF als Volltext kostenfreie Datei Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
Schlagwörter	Computer Assisted Testing; Test Items; Item Response Theory; Scoring; Goodness of Fit; Psychometrics; Problem Solving; Models; Adaptive Testing + Suchen Sie Ihr Suchwort? Test content; Testaufgabe; Item-Response-Theorie; Bewertung; Psychometry; Psychometrie; Problemlösen; Analogiemodell
Abstract	Testing programs have explored the use of technology-enhanced items alongside traditional item types (e.g., multiple-choice and constructed-response items) as measurement evidence of latent constructs modeled with item response theory (IRT). In this report, we discuss considerations in applying IRT models to a particular type of adaptive testlet referred to as a branching item. Under the branching format, all test takers are assigned to a common question, and the assignment of the next question relies on the response to the first question through deterministic rules. In addition, the items at both stages are scored together as one polytomous item. Real and simulated examples are provided to discuss challenges in applying IRT models to branching items. We find that model-data misfit is likely to occur when branching items are scored as polytomous items and modeled with the generalized partial credit model and that the relationship between the discrimination of the routing component and the discriminations of the subsequent components seemed to drive the misfit. We conclude with lessons learned and provide suggested guidelines and considerations for operationalizing the use of branching items in future assessments. (As Provided).
Anmerkungen	Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01