Comparing Small-Sample Equating with Angoff Judgement for Linking Cut-Scores on Two Tests

Autor/in	Bramley, Tom
Titel	Comparing Small-Sample Equating with Angoff Judgement for Linking Cut-Scores on Two Tests
Quelle	In: Research Matters, (2020) 29, S.23-27 (5 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1755-6031
Schlagwörter	Cutting Scores; Standard Setting (Scoring); Equated Scores; Accuracy; Measurement; Test Items; Difficulty Level; Sampling; Sample Size; Simulation; Correlation; Error of Measurement + Suchen Sie Ihr Suchwort? Bewertungsskala; Messverfahren; Test content; Testaufgabe; Schwierigkeitsgrad; Simulation program; Simulationsprogramm; Korrelation; Messfehler
Abstract	The aim of this study was to compare, by simulation, the accuracy of mapping a cut-score from one test to another by expert judgement (using the Angoff method) versus the accuracy with a small-sample equating method (chained linear equating). As expected, the standard-setting method resulted in more accurate equating when we assumed a higher level of correlation between simulated expert judgements of item difficulty and empirical difficulty. For small-sample equating with 90 examinees per test, more accurate equating arose from using simple random sampling compared to cluster sampling at the same sample size. The overall equating error depended on where on the mark scale the cut-score was located. The simulations based on a realistic value for the correlation between judged and empirical difficulty (0.6) produced a similar overall error to small-sample equating with cluster sampling. Simulations of standard-setting based on a very optimistic correlation of 0.9 had the lowest error of all. (As Provided).
Anmerkungen	University of Cambridge Local Examinations Syndicate (Cambridge Assessment). The Triangle Building, Shaftesbury Road, Cambridge, United Kingdom CB2 8EA. Tel: +44-1223-553311; e-mail: info@cambridgeassessment.org.uk; Web site: https://www.cambridgeassessment.org.uk/our-research/all-published-resources/research-matters/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01