Development and Validation of an Integrated STEM Teacher Classroom Observation Protocol

Autor/inn/en	Zhou, Shuqi; Merzdorf, Hillary E.; Douglas, Kerrie A.; Moore, Tamara J.
Titel	Development and Validation of an Integrated STEM Teacher Classroom Observation Protocol
Quelle	In: Journal of Pre-College Engineering Education Research, 13 (2023) 1, S.20-36, Artikel 2 (19 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Zhou, Shuqi)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
Schlagwörter	Test Construction; Test Validity; STEM Education; Classroom Observation Techniques; Integrated Curriculum; Elementary Secondary Education; Elementary School Teachers; Curriculum Implementation; Teacher Evaluation; Test Reliability; Interrater Reliability + Suchen Sie Ihr Suchwort? Testaufbau; Testvalidität; STEM; Elementary school; Teacher; Teachers; Grundschule; Volksschule; Lehrer; Lehrerin; Lehrende; Teacher appraisal; Lehrerbeurteilung; Testreliabilität; Interrater-Reliabilität
Abstract	This study aimed to develop a K-12 classroom observation protocol to assess K-12 teachers' implementation of science, technology, engineering, and mathematics (STEM) integration. The intended purpose of the observation protocol is for researchers to examine how K-12 teachers implement the STEM integrated curriculum. Based on research on STEM integration, the protocol covers eight categories: "Define," "Learn," "Plan," "Try," "Test," "Decide," "Improve," and "Instructional Strategies." The protocol was reviewed by a panel of integrated STEM education experts, engineering design experts, and educational assessment experts (n = 15) and revised accordingly. To test the reliability of using the protocol, two raters applied the protocol to videos of 12 lower-level elementary teachers located at seven schools who implemented an integrated STEM curriculum over a total of 196 class periods. The inter-rater reliability Gwet AC1 coefficient was 0.73. The inter-rater reliability of each category's coding was also calculated and reported. We discuss the implications and limitations of the protocol. (As Provided).
Anmerkungen	Purdue University Press. Stewart Center Room 370, 504 West State Street, West Lafayette, IN 47907. Tel: 800-247-6553; Fax: 419-281-6883; e-mail: pupress@purdue,edu; Web site: http://docs.lib.purdue.edu/jpeer/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01