Thinking Outside the Self-Report: Using Evaluation Plans to Assess Evaluation Capacity Building

Autor/inn/en	Wingate, Lori A.; Robertson, Kelly; FitzGerald, Michael; Rucks, Lana; Tsuzaki, Takara; Clasen, Carla; Schwob, Jeremy
Titel	Thinking Outside the Self-Report: Using Evaluation Plans to Assess Evaluation Capacity Building
Quelle	In: American Journal of Evaluation, 43 (2022) 4, S.515-538 (24 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Wingate, Lori A.) ORCID (Tsuzaki, Takara)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1098-2140
DOI	10.1177/10982140211062884
Schlagwörter	Measurement Techniques; Evaluation Methods; Capacity Building; Program Evaluation; Scoring Rubrics; Training; Knowledge Level; Evaluators; Program Proposals + Suchen Sie Ihr Suchwort? Messtechnik; Programme evaluation; Programmevaluation; Scoring formulas; Auswertungsbogen; Ausbildung; Wissensbasis
Abstract	In this study, we investigated the impact of the evaluation capacity building (ECB) efforts of an organization by examining the evaluation plans included in funding proposals over a 14-year period. Specifically, we sought to determine the degree to which and how evaluation plans in proposals to one National Science Foundation (NSF) program changed over time and the extent to which the organization dedicated to ECB in that program may have influenced those changes. Independent raters used rubrics to assess the presence of six essential evaluation plan elements. Statistically significant correlations indicate that proposal evaluation plans improved over time, with noticeable differences before and after ECB efforts were integrated into the program. The study adds to the limited literature on using artifacts of evaluation practice rather than self-reports to assess ECB impact. (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01