Comparison of NOHARM and DETECT in Item Cluster Recovery: Counting Dimensions and Allocating Items

Autor/inn/en	Finch, Holmes; Habing, Brian
Titel	Comparison of NOHARM and DETECT in Item Cluster Recovery: Counting Dimensions and Allocating Items
Quelle	In: Journal of Educational Measurement, 42 (2005) 2, S.149-169 (21 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0022-0655
DOI	10.1111/j.1745-3984.2005.00008
Schlagwörter	Program Effectiveness; Monte Carlo Methods; Item Response Theory; Comparative Analysis; Evaluation Methods; College Entrance Examinations; Basic Skills; Tests; Test Items; SAT (College Admission Test) + Suchen Sie Ihr Suchwort? Monte-Carlo-Methode; Item-Response-Theorie; Aufnahmeprüfung; Basic skill; Grundfertigkeit; Examination; Prüfung; Examen; Test content; Testaufgabe
Abstract	This study examines the performance of a new method for assessing and characterizing dimensionality in test data using the NOHARM model, and comparing it with DETECT. Dimensionality assessment is carried out using two goodness-of-fit statistics that are compared to reference X[2] distributions. A Monte Carlo study is used with item parameters based on a statewide basic skills assessment and the SAT. Other factors that are varied include the correlation among the latent traits, the number of items, the number of subjects, skewness of the latent traits, and the presence or absence of guessing. The performance of the two procedures is judged by the accuracy in determining the number of underlying dimensions, and the degree to which items are correctly clustered together. Results indicate that the new, NOHARM-based method appears to perform comparably to DETECT in terms of simultaneously finding the correct number of dimensions and clustering items correctly. NOHARM is generally better able to determine the number of underlying dimensions, but less able to group items together, than DETECT. When errors in item cluster assignment are made, DETECT is more likely to incorrectly separate items while NOHARM more often incorrectly groups them together. (Author).
Anmerkungen	Journal Customer Services, Blackwell Publishing, 350 Main Street, Malden, MA 02148. Tel: 800-835-6770 (Toll Free); Fax: 781-388-8232; e-mail: subscrip@bos.blackwellpublishing.com.
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10