Position of Correct Option and Distractors Impacts Responses to Multiple-Choice Items: Evidence from a National Test

Autor/inn/en	Lions, Séverin; Dartnell, Pablo; Toledo, Gabriela; Godoy, María Inés; Córdova, Nora; Jiménez, Daniela; Lemarié, Julie
Titel	Position of Correct Option and Distractors Impacts Responses to Multiple-Choice Items: Evidence from a National Test
Quelle	In: Educational and Psychological Measurement, 83 (2023) 5, S.861-884 (24 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Lions, Séverin)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0013-1644
DOI	10.1177/00131644221132335
Schlagwörter	Multiple Choice Tests; Test Items; Item Analysis; Responses; Error of Measurement; High Stakes Tests; Standardized Tests; Language Processing; Interference (Learning); Academic Achievement; Foreign Countries; College Entrance Examinations; Accuracy; Difficulty Level; Comparative Analysis; Reading Processes; Secondary School Students; Chile + Suchen Sie Ihr Suchwort? Multiple choice examinations; Multiple-choice tests, Multiple-choice examinations; Multiple-Choice-Verfahren; Test content; Testaufgabe; Itemanalyse; Messfehler; Standadised tests; Standardisierter Test; Sprachverarbeitung; Schulleistung; Ausland; Aufnahmeprüfung; Schwierigkeitsgrad; Leseprozess; Sekundarschüler
Abstract	Even though the impact of the position of response options on answers to multiple-choice items has been investigated for decades, it remains debated. Research on this topic is inconclusive, perhaps because too few studies have obtained experimental data from large-sized samples in a real-world context and have manipulated the position of both correct response and distractors. Since multiple-choice tests' outcomes can be strikingly consequential and option position effects constitute a potential source of measurement error, these effects should be clarified. In this study, two experiments in which the position of correct response and distractors was carefully manipulated were performed within a Chilean national high-stakes standardized test, responded by 195,715 examinees. Results show small but clear and systematic effects of options position on examinees' responses in both experiments. They consistently indicate that a five-option item is slightly easier when the correct response is in A rather than E and when the most attractive distractor is after and far away from the correct response. They clarify and extend previous findings, showing that the appeal of all options is influenced by position. The existence and nature of a potential interference phenomenon between the options' processing are discussed, and implications for test development are considered. (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01