The Effect of the Modality Principle to Support Learning with Virtual Reality: An Eye-Tracking and Electrodermal Activity Study

Autor/inn/en	Liberman, Liat; Dubovi, Ilana
Titel	The Effect of the Modality Principle to Support Learning with Virtual Reality: An Eye-Tracking and Electrodermal Activity Study
Quelle	In: Journal of Computer Assisted Learning, 39 (2023) 2, S.547-557 (11 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Dubovi, Ilana)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0266-4909
DOI	10.1111/jcal.12763
Schlagwörter	Eye Movements; Retention (Psychology); Computer Simulation; Instructional Design; Cognitive Processes; Instructional Effectiveness; Multimedia Instruction; Teaching Methods; Comparative Analysis; Speech Communication; Computer Assisted Instruction; Cognitive Ability; Knowledge Level; Tests; Physiology + Suchen Sie Ihr Suchwort? Augenbewegung; Merkfähigkeit; Computergrafik; Computersimulation; Lesson concept; Lessonplan; Unterrichtsentwurf; Cognitive process; Kognitiver Prozess; Unterrichtserfolg; Multimediales Lernen; Teaching method; Lehrmethode; Unterrichtsmethode; Computer based training; Computerunterstützter Unterricht; Denkfähigkeit; Wissensbasis; Examination; Prüfung; Examen; Physiologie
Abstract	Background: Virtual reality (VR) is considered a promising approach to support learning. An instructional design is essential to optimize cognitive processes. Studies show that VR has unique instructional and pedagogical requirements. Objectives: To evaluate the effectiveness and applicability of the modality principle, which was previously validated in 2D classic multimedia, for learning with VR. The modality principle states that multimedia information presented as spoken narration is superior to on-screen text. Methods: A prospective experimental study with two compared conditions of instruction: VR-based learning guided by on-screen text (n = 34) versus spoken narration (n = 28). Students' cognitive learning experiences were captured by eye-tracking and electrodermal activity (EDA). In addition, students' knowledge was evaluated using a pre-post knowledge test. Results and Conclusions: Overall, there was no significant difference in knowledge retention between the participants who learned with on-screen text compared to spoken narration. However, results from the eye-tracking analysis showed that students who learned with the on-screen text devoted longer visual attention toward important learning activity areas of interest, suggesting a better ability to discern between relevant and irrelevant information. Conversely, students who learned with the spoken narration expressed significantly more EDA peak responses, proposing a higher cognitive load. Implications: This study outlines that while learning with VR was effective, the modality principle might not apply to learning with VR. Moreover, the analysis of the learning process suggests even an inverse effect, favouring the provision of instructional scaffolds as on-screen text. Future research should evaluate this effect on long-term knowledge retention. (As Provided).
Anmerkungen	Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01