Assessing the Accuracy of Classwide Direct Observation Methods: Two Analyses Using Simulated and Naturalistic Data

Autor/inn/en	Dart, Evan H.; Radley, Keith C.; Briesch, Amy M.; Furlow, Christopher M.; Cavell, Hannah J.; Briesch, Amy M.
Titel	Assessing the Accuracy of Classwide Direct Observation Methods: Two Analyses Using Simulated and Naturalistic Data
Quelle	In: Behavioral Disorders, 41 (2016) 3, S.148-160 (13 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0198-7429
DOI	10.17988/BD-15-49.1
Schlagwörter	Observation; Intervention; Simulation; Statistical Analysis; Group Behavior; Comparative Analysis; Data; Classroom Observation Techniques; Student Behavior; Classroom Environment; Programming Languages + Suchen Sie Ihr Suchwort? Beobachtung; Simulation program; Simulationsprogramm; Statistische Analyse; Gruppenverhalten; Daten; Student behaviour; Schülerverhalten; Klassenklima; Unterrichtsklima
Abstract	Two studies investigated the accuracy of eight different interval-based group observation methods that are commonly used to assess the effects of classwide interventions. In Study 1, a Microsoft Visual Basic program was created to simulate a large set of observational data. Binary data were randomly generated at the student level to represent 30-min observations using a 15-s momentary time sampling procedure for 5,000 students distributed evenly across 200 classrooms. Additionally, five classroom types were generated to determine if the base rate of behavior affected the accuracy of each method. Each of the eight observation methods were applied to the simulated data and compared to a criterion to determine their accuracy in estimating rates of classroom behavior. A two-way ANOVA identified a significant main effect for observation method, F(3.40, 663.07) = 15,824.22, p < 0.001, and a significant interaction between coding method and classroom composition, F(13.60, 663.07) = 40.04, p < 0.001. In Study 2, to replicate Study 1 using authentic observation data, we compared the accuracy of the same eight methods using a small sample of observations collected in an actual classroom. The results of both studies suggest that six of the eight methods (i.e., two Individual methods and four Planned Activity Check methods) are accurate assessments of group behavior. Furthermore, although classroom composition was associated with statistically significant differences between the accurate methods, we do not consider them large enough to be practically relevant. (As Provided).
Anmerkungen	Council for Children with Behavioral Disorders. Council for Exceptional Children, 1110 North Glebe Road, Arlington, VA 22201-5704. Tel: 612-276-0140; Fax: 612-276-0142; Web site: http://www.ccbd.net/publications/behavioraldisorders
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01