Classroom Observation Systems in Context: A Case for the Validation of Observation Systems

Autor/inn/en	Liu, Shuangshuang; Bell, Courtney A.; Jones, Nathan D.; McCaffrey, Daniel F.
Titel	Classroom Observation Systems in Context: A Case for the Validation of Observation Systems
Quelle	In: Educational Assessment, Evaluation and Accountability, 31 (2019) 1, S.61-95 (35 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Liu, Shuangshuang)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1874-8597
DOI	10.1007/s11092-018-09291-3
Schlagwörter	Classroom Observation Techniques; Teacher Evaluation; Test Validity; Scores; Factor Structure; Classroom Environment; Instruction + Suchen Sie Ihr Suchwort? Teacher appraisal; Lehrerbeurteilung; Testvalidität; Faktorenstruktur; Klassenklima; Unterrichtsklima; Teaching process; Unterrichtsprozess
Abstract	Researchers and practitioners sometimes presume that using a previously "validated" instrument will produce "valid" scores; however, contemporary views of validity suggest that there are many reasons this assumption can be faulty. In order to demonstrate just some of the problems with this view, and to support comparisons of different observation protocols across contexts, we introduce and define the conceptual tool of an "observation system". We then describe psychometric evidence of a popular teacher observation instrument, Charlotte Danielson's Framework for Teaching, in three use contexts--a lower-stakes research context, a lower-stakes practice-based context, and a higher-stakes practice-based context. Despite sharing a common instrument, we find the three observation systems and their associated use contexts combine to produce different average teacher scores, variation in score distributions, and different levels of precision in scores. However, all three systems produce higher average scores in the classroom environment domain than the instructional domain and all three sets of scores support a one-factor model, whereas the Framework posits four factors. We discuss how the dependencies between aspects of observation systems and practical constraints leave researchers with significant validation challenges and opportunities. (As Provided).
Anmerkungen	Springer. Available from: Springer Nature. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01