Item Option Weighting of Achievement Tests: Comparative Study of Methods.

Autor/in	Downey, Ronald G.
Titel	Item Option Weighting of Achievement Tests: Comparative Study of Methods.
Quelle	, (22 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Dokumenttyp	gedruckt; online; Monographie
Schlagwörter	Achievement Tests; Comparative Analysis; Correlation; Grade Point Average; Higher Education; Mathematical Models; Measurement Techniques; Predictive Validity; Scoring; Statistical Analysis; Test Items; Test Reliability; Test Validity; Weighted Scores; SAT (College Admission Test) + Suchen Sie Ihr Suchwort? Achievement test; Achievement; Testing; Test; Tests; Leistungsbeurteilung; Leistungsüberprüfung; Leistung; Testdurchführung; Testen; Korrelation; Hochschulbildung; Hochschulsystem; Hochschulwesen; Mathematical model; Mathematisches Modell; Messtechnik; Bewertung; Statistische Analyse; Test content; Testaufgabe; Testreliabilität; Testvalidität
Abstract	Previous research has studied the effects of different methods of item option weighting on the reliability and concurrent and predictive validity of achievement tests. Increases in reliability are generally found, but with mixed results for validity. Several methods of producing option weights, (i.e., Guttman internal and external weights and judges' weights), and their effects on reliability and concurrent, predictive, and face validity were examined. Option weights to maximize reliability produced crossvalidated increases in Hoyt reliability over rights-only scoring (.82 versus .58 respectively), decreases in correlations with other achievement tests, little changes in predictive validity, and a loss in face validity (i.e. some correct options had lower weights than incorrect options). Weights to maximize validity did not crossvalidate and led to a reduction in reliability and mixed validity results. Judges weights produced increases in reliability and mixed results with validity. The size of Guttman weights was shown to interact with item option and test characteristics. It was concluded that option weighting offered limited if any improvement over unit weighting. (Author/GDC)
Erfasst von	ERIC (Education Resources Information Center), Washington, DC