Learning as It Happens: A Decade of Analyzing and Shaping a Large-Scale Online Learning System

Autor/inn/en	Brinkhuis, Matthieu J. S.; Savi, Alexander O.; Hofman, Abe D.; Coomans, Frederik; van der Maas, Han L. J.; Maris, Gunter
Titel	Learning as It Happens: A Decade of Analyzing and Shaping a Large-Scale Online Learning System
Quelle	In: Journal of Learning Analytics, 5 (2018) 2, S.29-46 (18 Seiten)Infoseite zur Zeitschrift PDF als Volltext kostenfreie Datei Verfügbarkeit
Zusatzinformation	ORCID (Brinkhuis, Matthieu J. S.) ORCID (Savi, Alexander O.) ORCID (Hofman, Abe D.)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1929-7750
Schlagwörter	Data Analysis; Mathematics Instruction; Accuracy; Reaction Time; Scoring; Difficulty Level; Prediction; Item Analysis; Goodness of Fit; Achievement Gains; Mathematics Achievement; Elementary School Students; Foreign Countries; Computer Assisted Testing; Mathematics Tests; Computer Assisted Instruction; Arithmetic; Netherlands + Suchen Sie Ihr Suchwort? Auswertung; Mathematics lessons; Mathematikunterricht; Reaktionsvermögen; Bewertung; Schwierigkeitsgrad; Vorhersage; Itemanalyse; Achievement gain; Leistungssteigerung; Mathmatics sikills; Mathmatics achievement; Mathematical ability; Mathematische Kompetenz; Ausland; Computer based training; Computerunterstützter Unterricht; Addition; Arithmetik; Arithmetikunterricht; Rechnen; Niederlande
Abstract	With the advent of computers in education, and the ample availability of online learning and practice environments, enormous amounts of data on learning become available. The purpose of this paper is to present a decade of experience with analyzing and improving an online practice environment for math, which has thus far recorded over a billion responses. We present the methods we use to both steer and analyze this system in real-time, using scoring rules on accuracy and response times, a tailored rating system to provide both learners and items with current ability and difficulty ratings, and an adaptive engine that matches learners to items. Moreover, we explore the quality of fit by means of prediction accuracy and parallel item reliability. Limitations and pitfalls are discussed by diagnosing sources of misfit, like violations of unidimensionality and unforeseen dynamics. Finally, directions for development are discussed, including embedded learning analytics and a focus on online experimentation to evaluate both the system itself and the users' learning gains. Though many challenges remain open, we believe that large steps have been made in providing methods to efficiently manage and research educational big data from a massive online learning system. (As Provided).
Anmerkungen	Society for Learning Analytics Research. 121 Pointe Marsan, Beaumont, AB T4X 0A2, Canada. Tel: +61-429-920-838; e-mail: info@solaresearch.org; Web site: http://learning-analytics.info/journals/index.php/JLA/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01