Improving Accuracy in Measuring the Impact of Online Instruction on Students' Ability to Transfer Physics Problem-Solving Skills

Autor/inn/en	Whitcomb, Kyle M.; Guthrie, Matthew W.; Singh, Chandralekha; Chen, Zhongzhou
Titel	Improving Accuracy in Measuring the Impact of Online Instruction on Students' Ability to Transfer Physics Problem-Solving Skills
Quelle	In: Physical Review Physics Education Research, 17 (2021) 1, Artikel 010112 (12 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Guthrie, Matthew W.) ORCID (Singh, Chandralekha) ORCID (Chen, Zhongzhou)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	2469-9896
Schlagwörter	Accuracy; Measurement Techniques; Electronic Learning; Learning Modules; Transfer of Training; Problem Solving; Skill Development; Physics; Introductory Courses; Goal Orientation; Mastery Learning; Learning Motivation; Student Behavior; Self Management; Learning Strategies; Learning Analytics; Guessing (Tests); College Students; Florida + Suchen Sie Ihr Suchwort? Messtechnik; Learning module; Lernmodul; Training; Transfer; Ausbildung; Problemlösen; Kompetenzentwicklung; Qualifikationsentwicklung; Physik; Einführungskurs; Zielorientierung; Zielvorstellung; Motivation for studies; Lernmotivation; Student behaviour; Schülerverhalten; Selbstmanagement; Learning methode; Learning techniques; Lernmethode; Lernstrategie; Erraten; Collegestudent
Abstract	In two earlier studies, we developed a new method to measure students' ability to transfer physics problem-solving skills to new contexts using a sequence of online learning modules, and implemented two interventions in the form of additional learning modules designed to improve transfer ability. The current paper introduces a new data analysis scheme that could improve the accuracy of the measurement by accounting for possible differences in students' goal orientation and behavior, as well as revealing the possible mechanism by which one of the two interventions improves transfer ability. Based on a 2 × 2 framework of self-regulated learning, students with a performance-avoidance oriented goal are more likely to guess on some of the assessment attempts in order to save time, resulting in an underestimation of the student populations' transfer ability. The current analysis shows that about half of the students had frequent brief initial assessment attempts, and significantly lower correct rates on certain modules, which we think is likely to have originated at least in part from students adopting a performance-avoidance strategy. We then divided the remaining population, for which we can be certain that few students adopted a performance-avoidance strategy, based on whether they interacted with one of the intervention modules designed to develop basic problem-solving skills, or passed that module on their first attempt without interacting with the instructional material. By comparing to propensity score matched populations from a previous semester, we found that the improvement in subsequent transfer performance observed in a previous study mainly came from the latter population, suggesting that the intervention served as an effective reminder for students to activate existing skills, but fell short of developing those skills among those who have yet to master it. (As Provided).
Anmerkungen	American Physical Society. One Physics Ellipse 4th Floor, College Park, MD 20740-3844. Tel: 301-209-3200; Fax: 301-209-0865; e-mail: assocpub@aps.org; Web site: http://prst-per.aps.org
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01