Applying a Contrasting Groups Standard Setting Methodology to a Large-Scale Performance Assessment Program Used for Accountability

Autor/in	Evans, Carla M.
Titel	Applying a Contrasting Groups Standard Setting Methodology to a Large-Scale Performance Assessment Program Used for Accountability
Quelle	In: Practical Assessment, Research & Evaluation, 28 (2023), Artikel 4 (16 Seiten)Infoseite zur Zeitschrift PDF als Volltext kostenfreie Datei Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
Schlagwörter	Standard Setting; Accountability; Performance Based Assessment; State Programs; Quality Assurance; State Standards; Decision Making; Barriers; Testing; Student Evaluation; Scores; Academic Achievement; Elementary Secondary Education; Educational Legislation; Federal Legislation; Mathematics Achievement; English; Language Arts; College Entrance Examinations; Teacher Attitudes; Teacher Surveys; Competency Based Education; New Hampshire; SAT (College Admission Test) + Suchen Sie Ihr Suchwort? Standardisierung; Verantwortung; Leistungsermittlung; Regierungsprogramm; Qualitätssicherung; Decision-making; Entscheidungsfindung; Testdurchführung; Testen; Schulnote; Studentische Bewertung; Schulleistung; Bildungsrecht; Schulgesetz; Bundesrecht; Mathmatics sikills; Mathmatics achievement; Mathematical ability; Mathematische Kompetenz; English language; Englisch; Sprachkultur; Aufnahmeprüfung; Lehrerverhalten; Education; Competence; Competency; Competency-based education; Unterricht; Kompetenzorientierte Methode
Abstract	Large-scale performance assessment programs are a longstanding reform tool. However, standard setting can be a challenge for assessment programs that use primarily non-standardized assessments. The purpose of this paper is to extend this field of research by explaining the standard setting methodology applied to one more recent instantiation of a state performance assessment program. The second purpose of this paper is to discuss the data quality control and quality assurance challenges experienced after five years of applying the standard setting method. Recognizing the burgeoning interest again in large-scale performance assessment programs, the goal and intended contribution of this paper is to inform future decisions about selecting appropriate standard setting methods and dealing with unanticipated challenges that may arise during implementation based upon the lessons learned from one program. It is likely that other large-scale performance assessment programs may face similar operational challenges, especially those that do not rely on standardized tests or standardized administration procedures to produce annual determinations of student proficiency or other scores used for accountability purposes. Assessment system designers can use the insights in this paper to consider standard setting methods and how those methods may need to be adapted to promote technical quality. (As Provided).
Anmerkungen	Center for Educational Assessment. 813 North Pleasant Street, Amherst, MA 01002. e-mail: pare@umass.edu; Tel: 413-577-2180; Web site: https://scholarworks.umass.edu/pare
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01