Building the BIKE: Development and Testing of the Biotechnology Instrument for Knowledge Elicitation (BIKE)

Autor/inn/en	Witzig, Stephen B.; Rebello, Carina M.; Siegel, Marcelle A.; Freyermuth, Sharyn K.; Izci, Kemal; McClure, Bruce
Titel	Building the BIKE: Development and Testing of the Biotechnology Instrument for Knowledge Elicitation (BIKE)
Quelle	In: Research in Science Education, 44 (2014) 5, S.675-698 (24 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0157-244X
DOI	10.1007/s11165-014-9398-x
Schlagwörter	Test Construction; Scientific Concepts; Concept Formation; Knowledge Level; Evaluation Methods; Student Evaluation; Measures (Individuals); Biotechnology; Measurement Techniques; Interviews; College Faculty; Test Validity; Item Analysis; College Science; Pretests Posttests + Suchen Sie Ihr Suchwort? Testaufbau; Concept learning; Begriffsbildung; Wissensbasis; Schulnote; Studentische Bewertung; Messdaten; Biotechnologie; Messtechnik; Interviewing; Interviewtechnik; Fakultät; Testvalidität; Itemanalyse
Abstract	Identifying students' conceptual scientific understanding is difficult if the appropriate tools are not available for educators. Concept inventories have become a popular tool to assess student understanding; however, traditionally, they are multiple choice tests. International science education standard documents advocate that assessments should be reform based, contain diverse question types, and should align with instructional approaches. To date, no instrument of this type targeting student conceptions in biotechnology has been developed. We report here the development, testing, and validation of a 35-item Biotechnology Instrument for Knowledge Elicitation (BIKE) that includes a mix of question types. The BIKE was designed to elicit student thinking and a variety of conceptual understandings, as opposed to testing closed-ended responses. The design phase contained nine steps including a literature search for content, student interviews, a pilot test, as well as expert review. Data from 175 students over two semesters, including 16 student interviews and six expert reviewers (professors from six different institutions), were used to validate the instrument. Cronbach's alpha on the pre/posttest was 0.664 and 0.668, respectively, indicating the BIKE has internal consistency. Cohen's kappa for inter-rater reliability among the 6,525 total items was 0.684 indicating substantial agreement among scorers. Item analysis demonstrated that the items were challenging, there was discrimination among the individual items, and there was alignment with research-based design principles for construct validity. This study provides a reliable and valid conceptual understanding instrument in the understudied area of biotechnology. (As Provided).
Anmerkungen	Springer. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: service-ny@springer.com; Web site: http://www.springerlink.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10