Aligning Classroom Assessment with Engineering Practice: A Design-Based Research Study of a Two-Stage Exam with Authentic Assessment

Autor/inn/en	Koretsky, Milo D.; McColley, Campbell J.; Gugel, James L.; Ekstedt, Thomas W.
Titel	Aligning Classroom Assessment with Engineering Practice: A Design-Based Research Study of a Two-Stage Exam with Authentic Assessment
Quelle	In: Journal of Engineering Education, 111 (2022) 1, S.185-213 (29 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Koretsky, Milo D.)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1069-4730
DOI	10.1002/jee.20436
Schlagwörter	Performance Based Assessment; Alignment (Education); Engineering Education; Computer Assisted Testing; Decision Making; Student Attitudes + Suchen Sie Ihr Suchwort? Leistungsermittlung; Ingenieurausbildung; Decision-making; Entscheidungsfindung; Schülerverhalten
Abstract	Background: Authentic assessment and two-stage exams have recently received attention; however, they are rarely used together. We reimagine assessment by integrating an authentic, computer-based assessment into the structure of a two-stage exam in a large engineering class. Purpose: We seek to identify ways that such assessment extends classroom testing to better align with engineering practice by examining the ways teams negotiate uncertainty to make engineering decisions. We also identify differing students' reactions to increased uncertainty during tests. Design/Method: Using the methodical framework of design-based research, we analyze performance and reflection data for 117 student teams through two design iterations to explore four design and theoretical conjectures. Results: Teams chose multiple solution paths to this authentic task, an aspect that aligns with the characteristics of engineering practice that we seek to assess. In addition, the technology tool allows the evaluation of procedural accuracy for many of the teams' chosen paths. The teams' decision-making performances correlate; however, decision-making and traditional assessments do not correlate, suggesting they measure different competencies. The computer-based second stage provides a holistic assessment that shifts the messages that students implicitly receive about valued practices in the classroom. However, not all students took up the authentic group assessment in desired ways. Conclusions: Technology-based two-stage exams with authentic assessment show promise to shift testing practices in large engineering classes to include decision-making. Such assessments better align with engineering practices that are valued in the profession, but more work is needed to develop systems for widespread implementation. (As Provided).
Anmerkungen	Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01