Impact of Maintaining Assessment Emphasis on Three-Dimensional Learning as Organic Chemistry Moved Online

Autor/inn/en	Stowe, Ryan L.; Esselman, Brian J.; Ralph, Vanessa R.; Ellison, Aubrey J.; Martell, Jeffrey D.; DeGlopper, Kimberly S.; Schwarz, Cara E.
Titel	Impact of Maintaining Assessment Emphasis on Three-Dimensional Learning as Organic Chemistry Moved Online
Quelle	In: Journal of Chemical Education, 97 (2020) 9, S.2408-2420 (13 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Stowe, Ryan L.) ORCID (Esselman, Brian J.)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0021-9584
Schlagwörter	Student Evaluation; Organic Chemistry; Online Courses; Computer Assisted Testing; Science Tests; Affordances; Summative Evaluation; Outcomes of Education; Scores; Electronic Learning; Grading + Suchen Sie Ihr Suchwort? Schulnote; Studentische Bewertung; Organische Chemie; Online course; Online-Kurs; Lernleistung; Schulerfolg; Notengebung
Abstract	The affordances given to a structured, timed, and proctored paper exam are not as readily applicable in a digital medium. Accordingly, the rapid shift from in-person to online enactments may have forced instructors to consider changing their assessment practices and priorities. As assessments convey strong implicit messages about "what counts" in a given learning environment, altering what is assessed may have a profound impact on what students view as important in a course. Our four-instructor team sought to examine whether we were able to maintain emphasis on assessing "how" and "why" chemical phenomena occur online while minimizing negative impacts to students, teaching assistants, and ourselves. To support claims regarding the degree to which online assessments emphasized sensemaking relative to past exams, we characterized all summative assessments given in organic chemistry II enactments from 2016 to the present using the three-dimensional learning assessment protocol. To examine the impact of enrolling in a rapidly assembled online organic course on student outcomes, we examined the distribution of students who performed above, at, or below the final exam score predicted by their midterm performance and compared this distribution with historic norms. Results suggest that we were able to maintain emphasis on student sensemaking as our course moved online (~50% of points on exams administered remotely were dedicated to 3D performances). Additionally, the distribution of students enrolled this past spring who scored above, at, or below the final exam score predicted by their midterm performance was in line with historic norms. When taken in aggregate, our analyses suggest that organic chemistry-enrolled students maintained their ability to make sense of chemical phenomena after the pivot to online instruction. Consistent emphasis on assessing 3D learning online was achieved without adding appreciably to the burden on instructors or teaching assistants due to our assessment writing practices, streamlined approach to online grading, and pre-existing course resources. Instructional implications for assessment design, enacting team grading, and tracking student trajectories are provided in addition to a suite of assessment items with the potential to engage students in sensemaking. (As Provided).
Anmerkungen	Division of Chemical Education, Inc. and ACS Publications Division of the American Chemical Society. 1155 Sixteenth Street NW, Washington, DC 20036. Tel: 800-227-5558; Tel: 202-872-4600; e-mail: eic@jce.acs.org; Web site: http://pubs.acs.org/jchemeduc
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01