A Hierarchical Rater Model for Constructed Responses, with a Signal Detection Rater Model

Autor/inn/en	DeCarlo, Lawrence T.; Kim, YoungKoung; Johnson, Matthew S.
Titel	A Hierarchical Rater Model for Constructed Responses, with a Signal Detection Rater Model
Quelle	In: Journal of Educational Measurement, 48 (2011) 3, S.333-356 (24 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0022-0655
DOI	10.1111/j.1745-3984.2011.00143.x
Schlagwörter	Responses; Essay Tests; Models; Scores; Perception; Bias; Theories + Suchen Sie Ihr Suchwort? Schriftlicher Sprachgebrauch; Analogiemodell; Wahrnehmung; Theory; Theorie
Abstract	The hierarchical rater model (HRM) recognizes the hierarchical structure of data that arises when raters score constructed response items. In this approach, raters' scores are not viewed as being direct indicators of examinee proficiency but rather as indicators of essay quality; the (latent categorical) quality of an examinee's essay in turn serves as an indicator of the examinee's proficiency, thus yielding a hierarchical structure. Here it is shown that a latent class model motivated by signal detection theory (SDT) is a natural candidate for the first level of the HRM, the rater model. The latent class SDT model provides measures of rater precision and various rater effects, above and beyond simply severity or leniency. The HRM-SDT model is applied to data from a large-scale assessment and is shown to provide a useful summary of various aspects of the raters' performance. (As Provided).
Anmerkungen	Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com/WileyCDA/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10