Assessing Teacher Effectiveness through Dual-Rater Classroom Observations: Researchers and District Staff Partnering to Create Calibrated Performance Evaluations

Autor/inn/en	Manzeske, David P.; Eno, Jared P.; Stonehill, Robert M.; Cumming, John M.; MacGillivary, Heather L.
Institution	Society for Research on Educational Effectiveness (SREE)
Titel	Assessing Teacher Effectiveness through Dual-Rater Classroom Observations: Researchers and District Staff Partnering to Create Calibrated Performance Evaluations
Quelle	(2014), (13 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Monographie
Schlagwörter	Teacher Effectiveness; Teacher Evaluation; Interrater Reliability; Classroom Observation Techniques; Performance Based Assessment; Elementary School Teachers; Middle School Teachers; Pilot Projects; Scoring Rubrics; Federal Legislation; Educational Legislation; Elementary Secondary Education; Federal Aid; Item Response Theory; School Districts + Suchen Sie Ihr Suchwort? Effectiveness of teaching; Instructional effectiveness; Lehrerleistung; Unterrichtserfolg; Teacher appraisal; Lehrerbeurteilung; Interrater-Reliabilität; Leistungsermittlung; Elementary school; Teacher; Teachers; Grundschule; Volksschule; Lehrer; Lehrerin; Lehrende; Middle school; Middle schools; Mittelschule; Mittelstufenschule; Pilot project; Modellversuch; Pilotprojekt; Scoring formulas; Auswertungsbogen; Bundesrecht; Bildungsrecht; Schulgesetz; Item-Response-Theorie; School district; Schulbezirk
Abstract	Federal policies (e.g., 2002 reauthorization of the Elementary and Secondary Education Act [ESEA] and the American Recovery and Reinvestment Act) posit that teacher quality is a potential leverage point for improving student achievement (U.S. Department of Education, 2010). Moreover, in the Race to the Top competition, teacher effectiveness must be based, in part, on teacher performance measured by classroom observations. This has driven many districts to adopt teacher classroom observation rubrics to meet the Race to the Top requirement. Without clear guidance on how to rate teachers and without proper calibration activities, scores on these rubrics can become upwardly biased, leading to an inability to distinguish among teachers at different performance levels (see, for example, Weisberg, Sexton, Mulhern, & Keeling, 2009). When a rubric is used inconsistently, teachers may not receive useful feedback, and the rubric could lack teacher buy-in, resulting in views that the evaluation does not provide credible information. In partnership with district central office staff, a study was conducted in a set of 20 elementary and middle schools in the western United States to investigate the use of a classroom observation rubric within the context of a district's pilot teacher performance evaluation system. The district wanted to know whether peer raters would use the observation rubric differently compared with principals, whether interrater reliability differed by rater type, and whether district-selected raters, on average, were more or less lenient than principals in rating other teachers. Supplemental tables and figures are appended. (ERIC).
Anmerkungen	Society for Research on Educational Effectiveness. 2040 Sheridan Road, Evanston, IL 60208. Tel: 202-495-0920; Fax: 202-640-4401; e-mail: inquiries@sree.org; Web site: http://www.sree.org
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01