Predicting Group Performance Using Process Data in a Collaborative Assessment

Autor/inn/en	Mohan, Kaushik; Bergner, Yoav; Halpin, Peter
Titel	Predicting Group Performance Using Process Data in a Collaborative Assessment
Quelle	In: Technology, Knowledge and Learning, 25 (2020) 2, S.367-388 (22 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Mohan, Kaushik)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	2211-1662
DOI	10.1007/s10758-020-09439-5
Schlagwörter	Computer Assisted Testing; Student Evaluation; Cooperation; Grade 12; Mathematics Tests; Synchronous Communication; Performance; Data Use; Prediction + Suchen Sie Ihr Suchwort? Schulnote; Studentische Bewertung; Co-operation; Kooperation; School year 12; 12. Schuljahr; Schuljahr 12; Achievement; Leistung; Vorhersage
Abstract	Technology-based assessments that involve collaboration among students offer many sources of process data, although it remains unclear which aspects of these data are most meaningful for making inferences about students' collaborative skills. Recent research has focused mainly on theory-based rubrics for qualitative coding of process data (e.g., text from chat dialogues, click-stream data), but many reliability and validity issues arise in the application of such rubrics. In this research, we take a more data-driven approach to the problem. Data were collected from 122 dyads who interacted over online chat to complete a twelfth-grade mathematics assessment. We focus on features of chat and click-stream that can be extracted automatically, including the extent to which chat dialogue contained content from assessment materials; chat-based cues of affective tone and mirroring; and temporal synchronization in task-related activities. Using a block-wise linear regression, we show that process features of chat and click-stream accounted for 30.5% of the variation in group performance, after controlling for group members math proficiency and the total number of words in the chat dialogue. The full model explained 61% of the variation in group performance. Implications for the design and scoring of collaborative assessments are discussed. (As Provided).
Anmerkungen	Springer. Available from: Springer Nature. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01