Validity of Scores for a Developmental Writing Scale Based on Automated Scoring

Autor/inn/en	Attali, Yigal; Powers, Donald
Titel	Validity of Scores for a Developmental Writing Scale Based on Automated Scoring
Quelle	In: Educational and Psychological Measurement, 69 (2009) 6, S.978-993 (16 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0013-1644
DOI	10.1177/0013164409332217
Schlagwörter	Validity; Measures (Individuals); Scoring; Essays; Scores; Grade 4; Grade 6; Grade 8; Grade 10; Grade 12; English; Writing Evaluation; Cues; Reliability; Longitudinal Studies; Basic Writing + Suchen Sie Ihr Suchwort? Gültigkeit; Messdaten; Bewertung; Essay; Aufsatzunterricht; School year 04; 4. Schuljahr; Schuljahr 04; School year 06; 6. Schuljahr; Schuljahr 06; School year 08; 8. Schuljahr; Schuljahr 08; School year 12; 12. Schuljahr; Schuljahr 12; English language; Englisch; Stichwort; Reliabilität; Longitudinal study; Longitudinal method; Longitudinal methods; Längsschnittuntersuchung
Abstract	A developmental writing scale for timed essay-writing performance was created on the basis of automatically computed indicators of writing fluency, word choice, and conventions of standard written English. In a large-scale data collection effort that involved a national sample of more than 12,000 students from 4th, 6th, 8th, 10th, and 12th grade, students wrote (in 30-min sessions) up to four essays in two modes of writing on topics selected from a pool of 20 topics. Scale scores were created by combining essay indicators in a standard way to compute essay scores that shared the same scoring standards across essay prompts and student grade levels. A series of ancillary analyses and studies were conducted to examine the validity of scale scores. Cross-classified random effects modeling of scores confirmed that the particular prompts on which essays are written have little effect on scores. The reliability of scores was found to be higher compared to previous reliability estimates of human essay scores. A human scoring experiment confirmed that the developmental sensitivity of scale scores and human scores was similar. A longitudinal study confirmed the expected gains in scores over a 1-year period. (Contains 7 tables.) (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10