Assessing Cognitive Presence in Online Inquiry-Based Discussion through Text Classification and Epistemic Network Analysis

Autor/inn/en	Ba, Shen; Hu, Xiao; Stein, David; Liu, Qingtang
Titel	Assessing Cognitive Presence in Online Inquiry-Based Discussion through Text Classification and Epistemic Network Analysis
Quelle	In: British Journal of Educational Technology, 54 (2023) 1, S.247-266 (20 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Ba, Shen) ORCID (Hu, Xiao)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0007-1013
DOI	10.1111/bjet.13285
Schlagwörter	Coaching (Performance); Computer Mediated Communication; Inquiry; Classification; Communities of Practice; Epistemology; Network Analysis; Coding; Content Analysis; Learning Analytics; Learning Trajectories + Suchen Sie Ihr Suchwort? Computerkonferenz; Classification system; Klassifikation; Klassifikationssystem; Community; Erkenntnistheorie; Netzplantechnik; Codierung; Programmierung; Inhaltsanalyse
Abstract	Providing coaching to participants in inquiry-based online discussions contributes to developing cognitive presence (CP) and higher-order thinking. However, a primary issue limiting quality and timely coaching is instructors' lack of tools to efficiently identify CP phases in massive discussion transcripts and effectively assess learners' cognitive development. This study examined a computational approach integrating text mining and co-occurrence analysis for assessing CP and cognitive development in online discussions based on the community of inquiry (CoI) framework. First, text classifiers trained on different language models were evaluated for identifying and coding the CP phases. Second, epistemic network analysis (ENA) was employed to model cognitive patterns reflected by co-occurrences between the coding elements. Results indicated that text classifiers trained on the state-of-the-art language model Bidirectional Encoder Representations from Transformers (BERT) can address the efficiency issue in coding CP phases in discussion transcripts and obtain substantial agreements (Cohen's "k" = 0.76) with humans, which outperformed other baseline classifiers. Furthermore, compared to traditional quantitative content analysis, ENA can effectively model the temporal characteristics of online discourse and detect fine-grained cognitive patterns. Overall, the findings suggest a feasible path for applying learning analytics to tracking learning progression and informing theory-based assessments. (As Provided).
Anmerkungen	Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01