Multisite Educational Trials: Estimating the Effect Size and Its Confidence Intervals

Autor/inn/en	Singh, Akansha; Uwimpuhwe, Germaine; Li, Mengchu; Einbeck, Jochen; Higgins, Steve; Kasim, Adetayo
Titel	Multisite Educational Trials: Estimating the Effect Size and Its Confidence Intervals
Quelle	In: International Journal of Research & Method in Education, 45 (2022) 1, S.18-38 (21 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Singh, Akansha) ORCID (Uwimpuhwe, Germaine) ORCID (Higgins, Steve) ORCID (Kasim, Adetayo)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1743-727X
DOI	10.1080/1743727X.2021.1882416
Schlagwörter	Randomized Controlled Trials; Effect Size; Hierarchical Linear Modeling; Least Squares Statistics; Intervals; Foreign Countries; Educational Research; United Kingdom (England) + Suchen Sie Ihr Suchwort? Ausland; Bildungsforschung; Pädagogische Forschung
Abstract	In education, multisite trials involve randomization of pupils into intervention and comparison groups within schools. Most analytical models in multisite educational trials ignore that the impact of an intervention may be school dependent. This study investigates the impact of statistical models on the uncertainty associated with an effect size using comparable outcomes and covariates from ten multisite educational trials funded by the UK's Education Endowment Foundation. Ordinary least squares (OLS) models often assume that the pupil's outcomes within schools are independent, which is not always true. Multilevel models address this limitation by incorporating heterogeneity between schools to account for intra-school dependency. This inflates the confidence interval of an effect size obtained from the multilevel models than from an OLS model. For a multisite trial, the heterogeneity between schools also includes the differences in the expected impact of intervention between schools. Ignoring this additional school-by-intervention variation in a multisite trial could affect both its interpretation and conclusions. A robust approach to estimate the confidence intervals for effect size from multisite trials is by treating effect size as a parameter with its distribution. This paper is important for evaluating evidence from multisite trials by accounting for all sources of variability. (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01