A Comparison of Two Standard-Setting Methods for Tests Consisting of Constructed-Response Items

Autor/inn/en	Ozarkan, Hatun Betul; Dogan, Celal Deha
Titel	A Comparison of Two Standard-Setting Methods for Tests Consisting of Constructed-Response Items
Quelle	In: Eurasian Journal of Educational Research, (2020) 90, S.121-138 (18 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Zusatzinformation	ORCID (Ozarkan, Hatun Betul) ORCID (Dogan, Celal Deha)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1302-597X
Schlagwörter	Standard Setting (Scoring); Responses; Test Items; Cutting Scores; Comparative Analysis; Achievement Tests; Mathematics Tests; Grade 8; Classification; Mathematics Teachers; Middle School Students; Middle School Teachers; Foreign Countries; Turkey + Suchen Sie Ihr Suchwort? Bewertungsskala; Test content; Testaufgabe; Achievement test; Achievement; Testing; Test; Tests; Leistungsbeurteilung; Leistungsüberprüfung; Leistung; Testdurchführung; Testen; School year 08; 8. Schuljahr; Schuljahr 08; Classification system; Klassifikation; Klassifikationssystem; Mathematics; Teacher; Teachers; Mathematik; Lehrer; Lehrerin; Lehrende; Middle school; Middle schools; Student; Students; Mittelschule; Mittelstufenschule; Schüler; Schülerin; Ausland; Türkei
Abstract	Purpose: This study aimed to compare the cut scores obtained by the Extended Angoff and Contrasting Groups methods for an achievement test consisting of constructed-response items. Research Methods: This study was based on survey research design. In the collection of data, the study group of the research consisted of eight mathematics teachers for the Extended Angoff method, 75 eighth grade students, and a mathematics teacher for the Contrasting Groups method. Data were collected through math achievement test consisting of constructed-response items, scoring rubrics, expert opinion form for Extended Angoff method and student classification form for Contrasting Groups method. Findings: Cut score was determined to be 13,38 by the Extended Angoff method and 12,50 by the Contrasting Groups method. It has been determined that the two standard-setting methods do not make significant difference between the master accepted student ratios. It has been found that there is a high level of harmony between the methods in terms of classifying the students as qualified and unqualified. Implications for Research and Practice: This study was restricted to test consisting of constructed-response items and two standard-setting methods. It is suggested that future research tests should include different types of items and compare different methods. In the COVID-19 pandemic process, judge panel discussions can be made online in the Extended Angoff method. Online meetings can allow the creation of a heterogeneous judge group. Therefore, both methods can be used in the COVID-19 process. (As Provided).
Anmerkungen	ANI Publishing Company. Kizilirmak Sokak 10/A Bakanliklar, Ankara, Turkey 06440. Tel: +90-312-425-8150; Fax: +90-312-425-8111; e-mail: aniyayincilik@aniyayincilik.com.tr; Web site: http://www.ejer.com.tr
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01