Using Process Data to Understand Problem-Solving Strategies and Processes for Drag-and-Drop Items in a Large-Scale Mathematics Assessment

Autor/inn/en	Jiang, Yang; Gong, Tao; Saldivia, Luis E.; Cayton-Hodges, Gabrielle; Agard, Christopher
Titel	Using Process Data to Understand Problem-Solving Strategies and Processes for Drag-and-Drop Items in a Large-Scale Mathematics Assessment
Quelle	In: Large-scale Assessments in Education, 9 (2021), Artikel 2 (31 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Jiang, Yang)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	2196-0739
DOI	10.1186/s40536-021-00095-4
Schlagwörter	Data Use; Learning Analytics; Test Items; Measurement; Mathematics Tests; Computer Assisted Testing; Problem Solving; Misconceptions; National Competency Tests; Grade 4; Grade 8; National Assessment of Educational Progress + Suchen Sie Ihr Suchwort? Test content; Testaufgabe; Messverfahren; Problemlösen; Missverständnis; School year 04; 4. Schuljahr; Schuljahr 04; School year 08; 8. Schuljahr; Schuljahr 08
Abstract	In 2017, the mathematics assessments that are part of the National Assessment of Educational Progress (NAEP) program underwent a transformation shifting the administration from paper-and-pencil formats to digitally-based assessments (DBA). This shift introduced new interactive item types that bring rich process data and tremendous opportunities to study the cognitive and behavioral processes that underlie test-takers' performances in ways that are not otherwise possible with the response data alone. In this exploratory study, we investigated the problem-solving processes and strategies applied by the nation's fourth and eighth graders by analyzing the process data collected during their interactions with two technology-enhanced drag-and-drop items (one item for each grade) included in the first digital operational administration of the NAEP's mathematics assessments. Results from this research revealed how test-takers who achieved different levels of accuracy on the items engaged in various cognitive and metacognitive processes (e.g., in terms of their time allocation, answer change behaviors, and problem-solving strategies), providing insights into the common mathematical misconceptions that fourth- and eighth-grade students held and the steps where they may have struggled during their solution process. Implications of the findings for educational assessment design and limitations of this research are also discussed. (As Provided).
Anmerkungen	Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01