Gathering Evidence for Validity during the Design, Development, and Qualitative Evaluation of Thermochemistry Concept Inventory Items

Autor/inn/en	Wren, David; Barbera, Jack
Titel	Gathering Evidence for Validity during the Design, Development, and Qualitative Evaluation of Thermochemistry Concept Inventory Items
Quelle	In: Journal of Chemical Education, 90 (2013) 12, S.1590-1601 (12 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0021-9584
DOI	10.1021/ed400384g
Schlagwörter	Chemistry; Measures (Individuals); Test Construction; Test Validity; Qualitative Research; Feedback (Response); Content Validity; Science Teachers; Online Surveys; Teacher Surveys; Semi Structured Interviews; Protocol Analysis; Students; Misconceptions + Suchen Sie Ihr Suchwort? Chemie; Messdaten; Testaufbau; Testvalidität; Qualitative Forschung; Science; Teacher; Teachers; Science teacher; Wissenschaft; Lehrer; Lehrerin; Lehrende; Student; Schüler; Schülerin; Studentin; Missverständnis
Abstract	Assessment instruments developed specifically for chemistry classrooms have increased in number over the past decade. In the design, development, and evaluation of these instruments, the chemical education community has adopted many of the practices and standards used by the greater assessment communities. Methodologies for creating new assessment instruments now include collecting broad evidence for the validity of the uses and interpretations of data derived from an assessment instrument. The focus of this study is the design, development, and qualitative evaluation of concept inventory items for the Thermochemistry Concept Inventory (TCI). Qualitative research studies were used to obtain feedback from the primary stakeholders of the TCI. Evidence for content and response process validity are provided and used as arguments against the two threats to validity: construct underrepresentation and construct-irrelevant variance. In addition, a determination of the most important thermochemical topics taught in general chemistry classrooms is derived using feedback from general chemistry instructors' responses to an online survey. Semistructured, think-aloud interviews were used to identify alternative conceptions used by students answering open-ended questions. Qualitative data were used to develop a series of multiple-choice items that were then evaluated by students in retrospective think-loud interviews. These student interviews, along with additional interviews with general chemistry instructors, provide evidence for the response process validity of the items. (As Provided).
Anmerkungen	Division of Chemical Education, Inc and ACS Publications Division of the American Chemical Society. 1155 Sixteenth Street NW, Washington, DC 20036. Tel: 800-227-5558; Tel: 202-872-4600; e-mail: eic@jce.acs.org; Web site: http://pubs.acs.org/jchemeduc
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10