A Preliminary Study of Raters for the Test of Spoken English.

Autor/in	Bejar, Isaac I.
Institution	Educational Testing Service, Princeton, NJ.
Titel	A Preliminary Study of Raters for the Test of Spoken English.
Quelle	(1985), (44 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Monographie
Schlagwörter	Analysis of Covariance; Cost Effectiveness; English (Second Language); Evaluation Criteria; Evaluation Methods; Evaluators; Factor Structure; Feasibility Studies; Higher Education; Interrater Reliability; Language Tests; Oral English; Scoring; Speech Tests; Standards; Test Reliability; Test Validity + Suchen Sie Ihr Suchwort? Kosten-Nutzen-Analyse; Kosten-Nutzen-Denken; English as second language; English; Second Language; Englisch als Zweitsprache; Faktorenstruktur; Hochschulbildung; Hochschulsystem; Hochschulwesen; Interrater-Reliabilität; Language test; Sprachtest; Bewertung; Sprechtest; Standard; Testreliabilität; Testvalidität
Abstract	The feasibility of reducing scoring costs for the Test of Spoken English (TSE) by using one rater was investigated. Currently, two raters are used. It was found that, because of the possibility of different standards used by potential raters, it does not appear feasible to use a single rater as the sole determiner of speaking proficiency under the current system. Other possible alternatives were also examined. One approach was the development of a quality control index which would predict the extent of the disagreement between two raters, but the index that was developed could not be validated. The best predictors of rater disagreement were the identities of the raters. Their disagreements, however, resulted from the differing standards they used. Raters agreed substantially about the ordering of examinees, but varied slightly in the severity of their ratings. (Author/GDC)
Erfasst von	ERIC (Education Resources Information Center), Washington, DC