Why Does Construct Validity Matter in Measuring Implementation Fidelity? A Methodological Case Study

Autor/inn/en	van Dijk, Wilhelmina; Huggins-Manley, A. Corinne; Gage, Nicholas A.; Lane, Holly B.; Coyne, Michael
Titel	Why Does Construct Validity Matter in Measuring Implementation Fidelity? A Methodological Case Study
Quelle	In: Assessment for Effective Intervention, 47 (2022) 2, S.67-78 (12 Seiten) PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (van Dijk, Wilhelmina)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1534-5084
DOI	10.1177/1534508421998772
Schlagwörter	Construct Validity; Fidelity; Program Implementation; Reading Programs; Intervention; Reading Instruction; Elementary School Students; Dynamic Indicators of Basic Early Literacy Skills (DIBELS); Woodcock Reading Mastery Test + Suchen Sie Ihr Suchwort? Leseunterricht
Abstract	In reading intervention research, implementation fidelity is assumed to be positively related to student outcomes, but the methods used to measure fidelity are often treated as an afterthought. Fidelity has been conceptualized and measured in many different ways, suggesting a lack of construct validity. One aspect of construct validity is the fidelity index of a measure. This methodological case study examined how different decisions in fidelity indices influence relative rank ordering of individuals on the construct of interest and influence our perception of the relation between the construct and intervention outcomes. Data for this study came from a large state-funded project to implement multi-tiered systems of support for early reading instruction. Analyses were conducted to determine whether the different fidelity indices are stable in relative rank ordering participants and if fidelity indices of dosage and adherence data influence researcher decisions on model building within a multilevel modeling framework. Results indicated that the fidelity indices resulted in different relations to outcomes with the most commonly used fidelity indices for both dosage and adherence being the worst performing. The choice of index to use should receive considerable thought during the design phase of an intervention study. (As Provided).
Anmerkungen	SAGE Publications and Hammill Institute on Disabilities. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01