Direct Behavior Rating (DBR): Generalizability and Dependability across Raters and Observations

Autor/inn/en	Christ, Theodore J.; Riley-Tillman, T. Chris; Chafouleas, Sandra M.; Boice, Christina H.
Titel	Direct Behavior Rating (DBR): Generalizability and Dependability across Raters and Observations
Quelle	In: Educational and Psychological Measurement, 70 (2010) 5, S.825-843 (19 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	Weitere Informationen
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0013-1644
DOI	10.1177/0013164410366695
Schlagwörter	Generalizability Theory; Student Behavior; Data Collection; Student Evaluation; Alternative Assessment; Evaluators; Rating Scales; Undergraduate Students; Puzzles; Task Analysis + Suchen Sie Ihr Suchwort? Student behaviour; Schülerverhalten; Data capture; Datensammlung; Schulnote; Studentische Bewertung; Rating-Skala; Legespiel; Aufgabenanalyse
Abstract	Generalizability theory was used to examine the generalizability and dependability of outcomes from two single-item Direct Behavior Rating (DBR) scales: DBR of actively manipulating and DBR of visually distracted. DBR is a behavioral assessment tool with specific instrumentation and procedures that can be used by a variety of service delivery providers (e.g., teacher, teacher aide, parent, etc.) to collect time-series data on student behavior. The purpose of this study was to extend the findings presented by Chafouleas et al. with an examination of DBR outcomes as they are generalized across raters and rating occasions. One hundred twenty-five undergraduates viewed and rated student behavior on video clips while the children engaged in an unsolvable Lego puzzle task. A series of decision studies were used to evaluate the effects of alternate assessment conditions (variable numbers of raters and rating occasions) and interpretive assumptions (definitions of the universe of generalization). Results support the general conclusion that ratings from individual or small groups of simultaneous raters, when generalized only to that specific individual or group of individuals, can approach reliability criteria for low- and high-stakes decisions. Implications are discussed. (Contains 8 tables and 4 figures.) (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10