Influences of Response Rate and Distribution on the Calculation of Interobserver Reliability Scores

Autor/inn/en	Rolider, Natalie U.; Iwata, Brian A.; Bullock, Christopher E.
Titel	Influences of Response Rate and Distribution on the Calculation of Interobserver Reliability Scores
Quelle	In: Journal of Applied Behavior Analysis, 45 (2012) 4, S.753-762 (10 Seiten) PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0021-8855
Schlagwörter	Computation; Interrater Reliability; Intervals; Scores; Undergraduate Students + Suchen Sie Ihr Suchwort? Interrater-Reliabilität
Abstract	We examined the effects of several variations in response rate on the calculation of total, interval, exact-agreement, and proportional reliability indices. Trained observers recorded computer-generated data that appeared on a computer screen. In Study 1, target responses occurred at low, moderate, and high rates during separate sessions so that reliability results based on the four calculations could be compared across a range of values. Total reliability was uniformly high, interval reliability was spuriously high for high-rate responding, proportional reliability was somewhat lower for high-rate responding, and exact-agreement reliability was the lowest of the measures, especially for high-rate responding. In Study 2, we examined the separate effects of response rate per se, bursting, and end-of-interval responding. Response rate and bursting had little effect on reliability scores; however, the distribution of some responses at the end of intervals decreased interval reliability somewhat, proportional reliability noticeably, and exact-agreement reliability markedly. (Contains 2 figures and 1 table.) (As Provided).
Anmerkungen	Society for the Experimental Analysis of Behavior. Available from: Department of Applied Behavioral Science. Kansas University, 1000 Sunnyside Avenue, Lawrence, KS 66045-2133. Tel: 785-841-4425; Fax: 785-841-4425; e-mail: behavior@mail.ku.edu; Web site: http://seab.envmed.rochester.edu/jaba/index.html
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10