Validation Studies for Early Learning and Care Quality Rating and Improvement Systems: A Review of the Literature. Working Paper WR-1051-DOEL

Literaturnachweis - Detailanzeige

Trefferliste

Autor/in	Karoly, Lynn A.
Institution	RAND Labor and Population; RAND Education; Delaware Office of Early Learning
Titel	Validation Studies for Early Learning and Care Quality Rating and Improvement Systems: A Review of the Literature. Working Paper WR-1051-DOEL
Quelle	(2014), (27 Seiten) PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Monographie
Schlagwörter	Rating Scales; Program Effectiveness; Early Childhood Education; Educational Quality; Validity; Child Care; Educational Improvement; Program Evaluation; Literature Reviews; Correlation; Evaluation Methods; Child Development; Outcomes of Education; Sampling; Verbal Ability; Intelligence Tests; Vocabulary; Emergent Literacy; Elementary School Students; Reading Tests; Reading Fluency; Cognitive Ability; Young Children; Motor Development; Questionnaires; Behavior Problems; Screening Tests; Child Behavior; Colorado; Florida; Indiana; Maine; Minnesota; Missouri; North Carolina; Oklahoma; Pennsylvania; Tennessee; Virginia; Dynamic Indicators of Basic Early Literacy Skills (DIBELS); Mullen Scales of Early Learning; Peabody Picture Vocabulary Test; Strengths and Difficulties Questionnaire; Woodcock Johnson Tests of Achievement + Suchen Sie Ihr Suchwort? Rating-Skala; Early childhood; Education; Frühkindliche Bildung; Frühpädagogik; Quality of education; Bildungsqualität; Gültigkeit; Kinderfürsorge; Kinderbetreuung; Teaching improvement; Unterrichtsentwicklung; Programme evaluation; Programmevaluation; Korrelation; Kindesentwicklung; Lernleistung; Schulerfolg; Mündliche Leistung; Intelligence test; Intelligenztest; Wortschatz; Frühleseunterricht; Lesetest; Denkfähigkeit; Frühe Kindheit; Motorische Entwicklung; Fragebogen; Screening-Verfahren
Abstract	Care Quality Rating and Improvement Systems (QRISs) have advanced and matured, a number of states and localities have undertaken evaluations to validate the systems. Such efforts stem from the desire to ensure that the system is designed and operating in the ways envisioned when the system was established. Given that a central component in a QRIS is the rating system, a key concern is whether the rating process, including the use of particular measures and the manner in which they are combined and cut scores are applied, produces accurate and understandable ratings that capture meaningful differences in program quality across rating levels. The aim of this paper is to review the set of studies that seek to validate QRIS rating systems in one of several ways: by examining the relationship between program ratings and objective measures of program quality; by determining if program ratings increase over time; and by estimating the relationship between program ratings and child developmental outcomes. Specifically, we review 14 such validation studies that address one or more of these three questions. Together, these 14 studies cover 12 QRISs in 11 states or substate areas: Colorado, Florida (two counties), Indiana, Maine, Minnesota, Missouri, North Carolina, Oklahoma, Pennsylvania, Tennessee, and Virginia. In reviewing the literature, we are interested in the methods and measures they employ, as well as the empirical results. To date, most validation studies have found that programs with higher ratings had higher environment rating scores (ERSs), but the ERS is often one of the rating elements. Independent measures of quality have not always shown the expected positive relationship with quality. The handful of studies that have examined how ratings change over time have generally shown that programs participating in the QRIS did improve their quality or quality ratings. Studies that examine the relationship between QRIS ratings and child development are the most challenging to implement and can be costly to conduct when independent child assessments are performed. Consequently, there has been considerable variation in methods to date across these studies. Among the four studies with the stronger designs, two found the expected relationship between QRIS ratings and child developmental gains. The lack of robust findings across these studies indicate that QRISs, as currently configured, do not necessarily capture differences in program quality that are predictive of gains in key developmental domains. Based on these findings, the paper discusses the opportunities for future QRIS validation studies, including those conducted as part of the Race to the Top-Early Learning Challenge grants, to advance the methods used and contribute not only to improvement of the QRIS in any given state, but also to add to the knowledge base about effective systems more generally. [This report was prepared for the Delaware Office of Early Learning.] (As Provided).
Anmerkungen	RAND Corporation. P.O. Box 2138, Santa Monica, CA 90407-2138. Tel: 877-584-8642; Tel: 310-451-7002; Fax: 412-802-4981; e-mail: order@rand.org; Web site: http://www.rand.org
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01