Being Reliable: Issues in Determining the Reliability and Making Sense of Observations of Adults with Congenital Deafblindness?

Autor/inn/en	Prain, M. I.; McVilly, K. R.; Ramcharan, P.
Titel	Being Reliable: Issues in Determining the Reliability and Making Sense of Observations of Adults with Congenital Deafblindness?
Quelle	In: Journal of Intellectual Disability Research, 56 (2012) 6, S.632-640 (9 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0964-2633
DOI	10.1111/j.1365-2788.2011.01503.x
Schlagwörter	Multiple Disabilities; Interrater Reliability; Researchers; Deaf Blind; Adults; Observation; Test Reliability; Genetic Disorders; Research Methodology; Interaction + Suchen Sie Ihr Suchwort? Multiple disability; Mehrfachbehinderung; Interrater-Reliabilität; Researcher; Forscher; Mehrfach Behinderter; Beobachtung; Testreliabilität; Research method; Forschungsmethode; Interaktion
Abstract	Background: Most research into interactions with people who are congenitally deafblind involves observational data. In order for practitioners and researchers to have confidence in the findings of observational studies, researchers need to demonstrate that the processes employed are replicable and trustworthy. This paper draws on data from an observational study of adults with congenital deafblindness to illustrate issues in determining inter-rater reliability, and interpreting observational data. Method: Data from 34 10-min observations of adults with congenital deafblindness and their interactions with support staff were assessed for inter-rater reliability using percentage agreement calculated in three different ways and Cohen's kappa. Results: Large variation resulted from the different ways in which inter-rater reliability was calculated, largely due to high levels of non-occurrence of many behaviours in the coding tool used. Conclusion: This study highlights the need to exercise caution when ascertaining the reliability of observational studies and demonstrates the value in using multiple methods for calculating inter-rater reliability. The paper concludes with an examination of the potential merits of using consensus coding in observational studies of interactions with people with congenital deafblindness or profound intellectual and multiple disabilities. (As Provided).
Anmerkungen	Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com/WileyCDA/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10