Literaturnachweis - Detailanzeige
| Autor/inn/en | Cohen, Yoav; Levi, Effi; Ben-Simon, Anat |
|---|---|
| Titel | Validating Human and Automated Scoring of Essays against "True" Scores |
| Quelle | In: Applied Measurement in Education, 31 (2018) 3, S.241-250 (10 Seiten)Infoseite zur Zeitschrift
PDF als Volltext |
| Zusatzinformation | ORCID (Cohen, Yoav) |
| Sprache | englisch |
| Dokumenttyp | gedruckt; online; Zeitschriftenaufsatz |
| ISSN | 0895-7347 |
| DOI | 10.1080/08957347.2018.1464450 |
| Schlagwörter | Test Validity; Automation; Scoring; Computer Assisted Testing; Test Scoring Machines; True Scores; Interrater Reliability; Correlation; High Stakes Tests; Foreign Countries; Statistical Analysis; Essays; Israel |
| Abstract | In the current study, two pools of 250 essays, all written as a response to the same prompt, were rated by two groups of raters (14 or 15 raters per group), thereby providing an approximation to the essay's true score. An automated essay scoring (AES) system was trained on the datasets and then scored the essays using a cross-validation scheme. By eliminating one, two, or three raters at a time, and by calculating an estimate of the true scores using the remaining raters, an independent criterion against which to judge the validity of the human raters and that of the AES system, as well as the interrater reliability was produced. The results of the study indicated that the automated scores correlate with human scores to the same degree as human raters correlate with each other. However, the findings regarding the validity of the ratings support a claim that the reliability and validity of AES diverge: although the AES scoring is, naturally, more consistent than the human ratings, it is less valid. (As Provided). |
| Anmerkungen | Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals |
| Erfasst von | ERIC (Education Resources Information Center), Washington, DC |
| Update | 2020/1/01 |
Literaturbeschaffung und Bestandsnachweise in Bibliotheken prüfen
Permalink als QR-Code
Inhalt auf sozialen Plattformen teilen (nur vorhanden, wenn Javascript eingeschaltet ist)
Teile diese Seite:
