An Analysis of the Ratings and Interrater Reliability of High School Band Contests

Autor/in	Hash, Phillip M.
Titel	An Analysis of the Ratings and Interrater Reliability of High School Band Contests
Quelle	In: Journal of Research in Music Education, 60 (2012) 1, S.81-100 (20 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0022-4294
DOI	10.1177/0022429411434932
Schlagwörter	Music Activities; Competition; Musicians; Interrater Reliability; Program Effectiveness; Evaluation Criteria; Outcome Measures; Comparative Analysis; Bias; Attitudes; South Carolina + Suchen Sie Ihr Suchwort? Musikalische Aktion; Wettkampf; Musiker; Interrater-Reliabilität; Attitude; Einstellung; Verhalten
Abstract	The purpose of this study was to examine procedures for analyzing ratings of large-group festivals and provide data with which to compare results from similar events. Data consisted of ratings from senior division concert band contests sponsored by the South Carolina Band Directors Association from 2008 to 2010. Three concert-performance and two sight-reading judges evaluated each band to determine a final rating. Research questions examined (a) frequency distributions of ratings; (b) interrater reliability as measured by Spearman correlation of individual judges' ratings, internal consistency ([alpha]), and two forms of interrater agreement (IRA); and (c) differences in mean ratings among individual adjudicators, contest sites, years, and classifications. The average final rating for all bands (N = 353) was 1.73, with 86.7% (n = 306) earning a I/Superior or II/Excellent. Interrater correlation, IRA, and internal consistency were higher for sight-reading versus concert performance. Each of these measures rose above the 0.80 benchmark for good reliability, except interrater correlation and average pairwise IRA in the concert portion of the contest. Data indicated significant differences in 8 out of 18 judging panels, in contest sites in 2010, and among ensemble classifications. In this study, the author demonstrated an effective procedure for analyzing ratings of large-group festivals and identified implications for improving these events. (Contains 5 tables.) (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10