Literaturnachweis - Detailanzeige
Autor/inn/en | Dempster, Edith R.; Kirby, Nicki F. |
---|---|
Titel | Inter-Rater Agreement in Assigning Levels of Difficulty to Examination Questions in Life Sciences |
Quelle | In: South African Journal of Education, 38 (2018) 3, Artikel 1539 (11 Seiten)Infoseite zur Zeitschrift
PDF als Volltext |
Zusatzinformation | ORCID (Dempster, Edith R.) ORCID (Kirby, Nicki F.) |
Sprache | englisch |
Dokumenttyp | gedruckt; online; Zeitschriftenaufsatz |
ISSN | 0256-0100 |
Schlagwörter | Foreign Countries; Interrater Reliability; Difficulty Level; Science Tests; Biological Sciences; Exit Examinations; Test Items; Test Reliability; Private Schools; Public Schools; Standards; South Africa |
Abstract | Public perception of "declining standards" in school-leaving examinations often accompanies increases in pass rates in schoolleaving examinations. "Declining standards" to the public means easier examination papers. The present study evaluates a South African attempt to estimate the level of difficulty, as distinct from cognitive demand, to exit-level examination papers in Life Sciences. A team of four expert raters assigned a level of difficulty ranging from 1 (easy) to 4 (very difficult). Invalid items were assigned a difficulty level of 0. The reference point was "the ideal average South African learner." Discussion and practice was conducted for 12 examination papers, followed by individual analysis of four examination papers. Inter-rater agreement for the final four papers was low. Raters assigned most items to difficulty levels 1 and 2, indicating that unreliability may be caused by the instrument having too many levels. Raters' predictions of levels of difficulty supported the actual mark distribution for private school candidates, but not for public school candidates. The "ideal average South African learner" is an unsuitable reference point in the unequal educational landscape of the public school system. We recommend that the instrument be modified by reducing the number of levels of difficulty and removing the hypothetical reference point. (As Provided). |
Anmerkungen | Education Association of South Africa. University of Pretoria, Centre for the Study of Resilience, Level 3, Groenkloof Student Centre, Department of Educational Psychology, Faculty of Education, George Storrar Road and Lleyds Street, Pretoria 0001, South Africa. Web site: http://www.sajournalofeducation.co.za/index.php/saje/index |
Erfasst von | ERIC (Education Resources Information Center), Washington, DC |
Update | 2020/1/01 |