Literaturnachweis - Detailanzeige
| Autor/in | Schnipke, Deborah L. |
|---|---|
| Titel | The Accuracy of Pass/Fail Decisions in Random and Difficulty-Balanced Domain-Sampling Tests. |
| Quelle | (2002), (10 Seiten)
PDF als Volltext kostenfreie Datei |
| Sprache | englisch |
| Dokumenttyp | gedruckt; online; Monographie |
| Schlagwörter | Decision Making; Difficulty Level; Item Banks; Pass Fail Grading; Simulation; Test Construction; Test Items |
| Abstract | A common practice in some certification fields (e.g., information technology) is to draw items from an item pool randomly and apply a common passing score, regardless of the items administered. Because these tests are commonly used, it is important to determine how accurate the pass/fail decisions are for such tests and whether fairly small, simple changes can be made to such tests to improve their psychometric properties without being too large a burden on the testing program. This simulation study compared a random test with a difficulty-balanced version of the test using 4 tests simulated for each of 1,000 examinees. Ability estimates and pass/fail decisions were slightly less accurate for the random test than for the difficulty-balanced test. The difference in difficulty distributions between the two test designs was dramatic. In addition, test takers who ended up failing the random test had harder tests on average than test takers in the difficulty-balanced test design, and those who ended up passing the random test had easier tests on average than test takers in the difficulty-balanced test design. From a fairness (and legal defensibility) point of view, the random test design is very undesirable. However, balancing tests on item difficulty is relatively easy to do. And this produced tests that are of equal difficulty across test takers and ability estimates and pass/fail decisions that are more accurate. Based on these results, it is recommended that testing programs that currently use random test designs switch to a difficulty-balanced test design. (Author/SLD) |
| Erfasst von | ERIC (Education Resources Information Center), Washington, DC |
Literaturbeschaffung und Bestandsnachweise in Bibliotheken prüfen
Permalink als QR-Code
Inhalt auf sozialen Plattformen teilen (nur vorhanden, wenn Javascript eingeschaltet ist)
Teile diese Seite:
