Measuring Widening Proficiency Differences in International Assessments: Are Current Approaches Enough?

Autor/inn/en	Rutkowski, David; Rutkowski, Leslie; Liaw, Yuan-Ling
Titel	Measuring Widening Proficiency Differences in International Assessments: Are Current Approaches Enough?
Quelle	In: Educational Measurement: Issues and Practice, 37 (2018) 4, S.40-48 (9 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0731-1745
DOI	10.1111/emip.12225
Schlagwörter	Educational Assessment; Foreign Countries; Achievement Tests; Secondary School Students; International Assessment; Test Items; Difficulty Level; Mathematics Tests; Test Bias; Simulation; Mathematics Achievement; Program for International Student Assessment + Suchen Sie Ihr Suchwort? Education; assessment; Bewertungssystem; Ausland; Achievement test; Achievement; Testing; Test; Tests; Leistungsbeurteilung; Leistungsüberprüfung; Leistung; Testdurchführung; Testen; Sekundarschüler; Test content; Testaufgabe; Schwierigkeitsgrad; Testkritik; Simulation program; Simulationsprogramm; Mathmatics sikills; Mathmatics achievement; Mathematical ability; Mathematische Kompetenz
Abstract	Participation in international large-scale assessments has grown over time with the largest, the Programme for International Student Assessment (PISA), including more than 70 education systems that are economically and educationally diverse. To help accommodate for large achievement differences among participants, in 2009 PISA offered low-performing systems the option of including an easier set of items in the assessment with an aim of providing improved achievement estimates. However, there remains a lack of evidence on the performance of this design innovation. As such, we simulate a design that closely mirrors the PISA 2015 math assessment in order to empirically examine the benefits of including easy items for low-performing countries. We extend the PISA design to include increased numbers of easy items and items that are easier than currently implemented. Findings show that the current PISA approach provides little advantage compared to a common test for all participants. Our study also demonstrates persistent bias, low coverage rates, and low correlations between generating and estimated proficiency under current designs. Through our simulation we also show that to improve achievement estimation for low performers about half of the items would need to be made significantly easier. (As Provided).
Anmerkungen	Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com/WileyCDA
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01