Comparing the Use of Global Rating Scale with Checklists for the Assessment of Central Venous Catheterization Skills Using Simulation

Autor/inn/en	Ma, Irene W. Y.; Zalunardo, Nadia; Pachev, George; Beran, Tanya; Brown, Melanie; Hatala, Rose; McLaughlin, Kevin
Titel	Comparing the Use of Global Rating Scale with Checklists for the Assessment of Central Venous Catheterization Skills Using Simulation
Quelle	In: Advances in Health Sciences Education, 17 (2012) 4, S.457-470 (14 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1382-4996
DOI	10.1007/s10459-011-9322-3
Schlagwörter	Health Education; Science Education; Comparative Analysis; Simulation; Medical Students; Graduate Students; Check Lists; Factor Analysis; Rating Scales; Evaluation Methods + Suchen Sie Ihr Suchwort? Gesundheitsaufklärung; Gesundheitsbildung; Gesundheitserziehung; Naturwissenschaftliche Bildung; Simulation program; Simulationsprogramm; Graduate Study; Student; Students; Aufbaustudium; Graduiertenstudium; Hauptstudium; Studentin; Checkliste; Faktorenanalyse; Rating-Skala
Abstract	The use of checklists is recommended for the assessment of competency in central venous catheterization (CVC) insertion. To explore the use of a global rating scale in the assessment of CVC skills, this study seeks to compare its use with two checklists, within the context of a formative examination using simulation. Video-recorded performances of CVC insertion by 34 first-year medical residents were reviewed by two independent, trained evaluators. Each evaluator used three assessment tools: a ten-item checklist, a 21-item checklist, and a nine-item global rating scale. Exploratory principal component analysis of the global rating scale revealed two factors, accounting for 84.1% of the variance: technical ability and safety. The two checklist scores correlated positively with the weighted factor score on technical ability (0.49 [95% CI 0.17-0.71] for the 10-item checklist; 0.43 [95% CI 0.10-0.67] for the 21-item checklist) and negatively with the weighted factor score on safety (-0.17 [95% CI -0.48-0.18] for the 10-item checklist; -0.13 [95% CI -0.45-0.22] for the 21-item checklist). A checklist score of less than 80% was strong indication of incompetence. However, a high checklist score did not preclude incompetence. Ratings using the global rating scale identified an additional 11 candidates (32%) who were deemed incompetent despite scoring greater than 80% on both checklists. All these candidates committed serious errors. In conclusion, the practice of universal adoption of checklists as the preferred method of assessment of procedural skills should be questioned. The inclusion of global rating scales should be considered. (As Provided).
Anmerkungen	Springer. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: service-ny@springer.com; Web site: http://www.springerlink.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10