Using Generalizability Theory and Multifacet Designs in the Validation of a Classroom Observation Instrument. [Report No.: SCRDT-RDM-79

Autor/in	Baker, J. Philip
Institution	Stanford Univ., CA. Stanford Center for Research and Development in Teaching.
Titel	Using Generalizability Theory and Multifacet Designs in the Validation of a Classroom Observation Instrument. [Report No.: SCRDT-RDM-79
Quelle	(1971), (17 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Dokumenttyp	gedruckt; online; Monographie
Schlagwörter	Analysis of Variance; Bias; Classroom Observation Techniques; Data Analysis; Generalization; Measurement Instruments; Measurement Techniques; Reliability; Test Reliability; Test Results; Theories + Suchen Sie Ihr Suchwort? Auswertung; Messtechnik; Reliabilität; Testreliabilität; Theory; Theorie
Abstract	The usefulness of generalizability theory in assessing the reliability of classroom observation instruments is illustrated, with a new index of reliability, called the coefficient of generalizability, given as an index of how well one can generalize from the instrument to the universe score according to the conditions of observation. Data from an instrument assessing verbal behavior are reanalyzed using generalizability theory. Three raters observed two classes of five student teachers, and three facets (class, occasion, and rater) were specified for study. Analysis of variance yielded the components of variance due to these facets, and ratio of the estimated universe. Score variance to the observed-score variance was computed as the coefficient of generalizability. The possible effect of various hypothetical conditions of observation on the coefficient of generalizability was considered. The results showed the coefficient of generalizability for one rater observing one class on one day was near zero for most of the summary variables for the instrument, but it increased when the number of observers and days of observation were increased. This was directly attributable to rater bias. Different observer training procedures might improve the usefulness of the instrument. (Author/LH)
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2004/1/01