The Dependence on Mathematical Theory in TIMSS, PISA and TIMSS Advanced Test Items and Its Relation to Student Achievement

Autor/inn/en	Hole, Arne; Grønmo, Liv Sissel; Onstad, Torgeir
Titel	The Dependence on Mathematical Theory in TIMSS, PISA and TIMSS Advanced Test Items and Its Relation to Student Achievement
Quelle	In: Large-scale Assessments in Education, 6 (2018), Artikel 3 (17 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Hole, Arne)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	2196-0739
DOI	10.1186/s40536-018-0055-0
Schlagwörter	International Assessment; Foreign Countries; Achievement Tests; Secondary School Students; Mathematics Achievement; Elementary Secondary Education; Mathematics Tests; Science Achievement; Science Tests; Test Items; Theories; Difficulty Level; Mathematics Education; Differences; Regional Characteristics; Item Response Theory; Program for International Student Assessment; Trends in International Mathematics and Science Study + Suchen Sie Ihr Suchwort? Ausland; Achievement test; Achievement; Testing; Test; Tests; Leistungsbeurteilung; Leistungsüberprüfung; Leistung; Testdurchführung; Testen; Sekundarschüler; Mathmatics sikills; Mathmatics achievement; Mathematical ability; Mathematische Kompetenz; Test content; Testaufgabe; Theory; Theorie; Schwierigkeitsgrad; Mathematische Bildung; Unterscheiden; Regionaler Faktor; Item-Response-Theorie
Abstract	Background: This paper discusses a framework for analyzing the dependence on mathematical theory in test items, that is, a framework for discussing to what extent knowledge of mathematical theory is helpful for the student in solving the item. The framework can be applied to any test in which some knowledge of mathematical theory may be useful, both within mathematics itself and in other subjects. The relevance of the framework is related to the important distinction between language and content in mathematical theory. Method: We used groups of scorers categorizing test items from TIMSS grade 8, PISA, and TIMSS Advanced. Differences in results across countries and groups of countries are analyzed. Results: Our results indicate, among other things, that the dependence on mathematical theory in the set of TIMSS Advanced 2015 physics test items is greater than in the set of PISA 2012 mathematics test items. Concerning relations to item difficulty, we find interesting differences in average p-values between the sets of item groups defined by our framework concerning participating countries and geographically defined groups of countries. Conclusions: The results indicate deep differences in mathematics teaching traditions and curricula in different regions of the world. Documenting such differences may help different educational systems learn from each other, and as such is relevant for all forms of educational research. (As Provided).
Anmerkungen	Springer. Available from: Springer Nature. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01