Literaturnachweis - Detailanzeige
| Autor/inn/en | Cousineau, Denis; Laurencelle, Louis |
|---|---|
| Titel | A Ratio Test of Interrater Agreement with High Specificity |
| Quelle | In: Educational and Psychological Measurement, 75 (2015) 6, S.979-1001 (23 Seiten)Infoseite zur Zeitschrift
PDF als Volltext |
| Sprache | englisch |
| Dokumenttyp | gedruckt; online; Zeitschriftenaufsatz |
| ISSN | 0013-1644 |
| DOI | 10.1177/0013164415574086 |
| Schlagwörter | Interrater Reliability; Monte Carlo Methods; Measurement Techniques; Accuracy; Statistical Analysis; Equations (Mathematics) |
| Abstract | Existing tests of interrater agreements have high statistical power; however, they lack specificity. If the ratings of the two raters do not show agreement but are not random, the current tests, some of which are based on Cohen's kappa, will often reject the null hypothesis, leading to the wrong conclusion that agreement is present. A new test of interrater agreement, applicable to nominal or ordinal categories, is presented. The test statistic can be expressed as a ratio (labeled Q[subscript A], ranging from 0 to infinity) or as a proportion (labeled P[subscript A], ranging from 0 to 1). This test weighs information supporting agreement with information supporting disagreement. This new test's effectiveness (power and specificity) is compared with five other tests of interrater agreement in a series of Monte Carlo simulations. The new test, although slightly less powerful than the other tests reviewed, is the only one sensitive to agreement only. We also introduce confidence intervals on the proportion of agreement. (As Provided). |
| Anmerkungen | SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com |
| Erfasst von | ERIC (Education Resources Information Center), Washington, DC |
| Update | 2020/1/01 |
Literaturbeschaffung und Bestandsnachweise in Bibliotheken prüfen
Permalink als QR-Code
Inhalt auf sozialen Plattformen teilen (nur vorhanden, wenn Javascript eingeschaltet ist)
Teile diese Seite:
