Literaturnachweis - Detailanzeige
Autor/in | Attali, Yigal |
---|---|
Titel | A Comparison of Newly-Trained and Experienced Raters on a Standardized Writing Assessment |
Quelle | In: Language Testing, 33 (2016) 1, S.99-115 (17 Seiten)Infoseite zur Zeitschrift
PDF als Volltext |
Sprache | englisch |
Dokumenttyp | gedruckt; online; Zeitschriftenaufsatz |
ISSN | 0265-5322 |
DOI | 10.1177/0265532215582283 |
Schlagwörter | Writing Evaluation; Writing Tests; Standardized Tests; Evaluators; Interrater Reliability; Essays; Feedback (Response); Scores; Training; Certification; Novices; Expertise; Comparative Analysis; Accuracy; Measurement; Factor Structure; Generalizability Theory; Factor Analysis |
Abstract | A short training program for evaluating responses to an essay writing task consisted of scoring 20 training essays with immediate feedback about the correct score. The same scoring session also served as a certification test for trainees. Participants with little or no previous rating experience completed this session and 14 trainees who passed an accuracy threshold proceeded to score other essays. Performance of the newly-trained raters was compared to that of 16 expert raters with extensive experience in scoring responses to the writing task. Results showed that the scores from the newly-trained group of raters exhibited similar measurement properties (mean and variability of scores, reliability and various validity coefficients, and underlying factor structure) to those from the experienced group of raters. Implications for the place of initial training and screening of raters on rater performance are discussed. (As Provided). |
Anmerkungen | SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com |
Erfasst von | ERIC (Education Resources Information Center), Washington, DC |
Update | 2020/1/01 |