Assessor Training: Its Effects on Criterion-Based Assessment in a Medical Context

Autor/inn/en	Pell, Godfrey; Homer, Matthew S.; Roberts, Trudie E.
Titel	Assessor Training: Its Effects on Criterion-Based Assessment in a Medical Context
Quelle	In: International Journal of Research & Method in Education, 31 (2008) 2, S.143-154 (12 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1743-727X
Schlagwörter	Medical Education; Standardized Tests; Clinical Experience; Criterion Referenced Tests; Robustness (Statistics); Student Evaluation; Test Reliability; Grading; Gender Differences; Interrater Reliability; Test Validity; Comparative Testing; Foreign Countries; United Kingdom (Leeds) + Suchen Sie Ihr Suchwort? Medizinische Ausbildung; Standadised tests; Standardisierter Test; Widerstandsfähigkeit; Schulnote; Studentische Bewertung; Testreliabilität; Notengebung; Geschlechterkonflikt; Interrater-Reliabilität; Testvalidität; Ausland
Abstract	Increasingly, academic institutions are being required to improve the validity of the assessment process; unfortunately, often this is at the expense of reliability. In medical schools (such as Leeds), standardized tests of clinical skills, such as "Objective Structured Clinical Examinations" (OSCEs) are widely used to assess clinical competence, both at the undergraduate and postgraduate levels. However, the issue of setting the pass marks or passing standard for such examinations remains contentious. The arrangements for particular OSCE assessment activities usually involve many different assessors, and have practical aspects that cannot be exactly duplicated across the cohort. These complexities therefore raise issues with respect to the robustness of the comparative student grading mechanism. This article addresses one aspect affecting the reliability of assessment, namely the effects of assessor training on the awarding of student marks. The article also investigates the interaction of gender between assessors, trained and untrained, and students. The findings, which are based on a detailed analysis of final year OSCE marks, indicate that untrained assessors award higher marks than trained assessors, and that a gender interaction exists; more specifically, that the use of untrained assessors tends to benefit female students over male students. The tension between reliability and validity has been particularly important in the field of medical education for a number of years--with medical students in the latter stages of their courses often being required to demonstrate competence in a variety of different simulated clinical activities with different patients, in front of different assessors in different hospitals and on different days. The complex nature of the OSCE arrangements raises serious questions as to the robustness of the setting the pass/fail boundary and, to a lesser extent, the honours boundaries. (Contains 2 figures, 4 tables, and 15 notes.) (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals/default.html
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10