A Multivariate Generalizability Analysis of Data from a Performance Assessment of Physicians' Clinical Skills

Autor/inn/en	Clauser, Brian E.; Harik, Polina; Margolis, Melissa J.
Titel	A Multivariate Generalizability Analysis of Data from a Performance Assessment of Physicians' Clinical Skills
Quelle	In: Journal of Educational Measurement, 43 (2006) 3, S.173-191 (19 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0022-0655
DOI	10.1111/j.1745-3984.2006.00012.x
Schlagwörter	Multivariate Analysis; Job Skills; Correlation; Test Items; Reports; Task Analysis; Licensing Examinations (Professions); Physician Patient Relationship; Performance Based Assessment; Generalizability Theory; Clinical Experience; Interaction Process Analysis; United States; United States Medical Licensing Examination + Suchen Sie Ihr Suchwort? Multivariate Analyse; Produktive Fertigkeit; Korrelation; Test content; Testaufgabe; Abschlussbericht; Berichten; Aufgabenanalyse; Arzt-Patient-Beziehung; Leistungsermittlung; Prozessanalyse; USA
Abstract	Although multivariate generalizability theory was developed more than 30 years ago, little published research utilizing this framework exists and most of what does exist examines tests built from tables of specifications. In this context, it is assumed that the universe scores from levels of the fixed multivariate facet will be correlated, but the error terms will be uncorrelated because subscores result from mutually exclusive sets of test items. This paper reports on an application in which multiple subscores are derived from each task completed by the examinee. In this context, both universe scores and errors may be correlated across levels of the fixed multivariate facet. The data described come from the United States Medical Licensing Examination[R] Step 2 Clinical Skills Examination. In this test, each examinee interacts with a series of standardized patients and each interaction results in four component scores. The paper focuses on the application of multivariate generalizability theory in this context and on the practical interpretation of the resulting estimated variance and covariance components. (Author).
Anmerkungen	Blackwell Publishing. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8599; Fax: 781-388-8232; e-mail: customerservices@blackwellpublishing.com; Web site: http://www.blackwellpublishing.com/jnl_default.asp.
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10