A New Methodological Approach for Evaluating the Impact of Educational Intervention Implementation on Learning Outcomes

Autor/inn/en	Outhwaite, Laura A.; Gulliford, Anthea; Pitchford, Nicola J.
Titel	A New Methodological Approach for Evaluating the Impact of Educational Intervention Implementation on Learning Outcomes
Quelle	In: International Journal of Research & Method in Education, 43 (2020) 3, S.225-242 (18 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1743-727X
DOI	10.1080/1743727X.2019.1657081
Schlagwörter	Randomized Controlled Trials; Intervention; Program Evaluation; Program Effectiveness; Program Implementation; Mathematics Instruction; Educational Technology; Technology Uses in Education; Young Children; Teacher Characteristics; Student Characteristics; Institutional Characteristics; Early Childhood Education; Foreign Countries; Teacher Role; Supervision; United Kingdom (England) + Suchen Sie Ihr Suchwort? Programme evaluation; Programmevaluation; Mathematics lessons; Mathematikunterricht; Unterrichtsmedien; Technology enhanced learning; Technology aided learning; Technologieunterstütztes Lernen; Frühe Kindheit; Early childhood; Education; Frühkindliche Bildung; Frühpädagogik; Ausland; Lehrerrolle
Abstract	Randomized control trials (RCTs) are commonly regarded as the 'gold standard' for evaluating educational interventions. While this experimental design is valuable in establishing causal relationships between the tested intervention and outcomes, reliance on statistical aggregation typically underplays the situated context in which interventions are implemented. Developing innovative, systematic methods for evaluating implementation and understanding its impact on outcomes is vital to moving educational evaluation research beyond questions of 'what works', towards better understanding the mechanisms underpinning an intervention's effects. The current study presents a pragmatic, two-phased approach that combines qualitative data with quantitative analyses to examine the causal relationships between intervention implementation and outcomes. This new methodological approach is illustrated in the context of a maths app intervention recently evaluated in a RCT across 11 schools. In phase I, four implementation themes were identified; 'teacher support', 'teacher supervision', 'implementation quality', and 'established routine'. In phase II, 'established routine' was found to predict 41% of the variance in children's learning outcomes with the apps. This has significant implications for future scaling. Overall, this new methodological approach offers an innovative method for combining process and impact evaluations when seeking to gain a more nuanced understanding of what works in education and why. (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01