Computer Science Meets Education: Natural Language Processing for Automatic Grading of Open-Ended Questions in eBooks

Autor/inn/en	Smith, Glenn Gordon; Haworth, Robert; Žitnik, Slavko
Titel	Computer Science Meets Education: Natural Language Processing for Automatic Grading of Open-Ended Questions in eBooks
Quelle	In: Journal of Educational Computing Research, 58 (2020) 7, S.1227-1255 (29 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Smith, Glenn Gordon)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0735-6331
DOI	10.1177/0735633120927486
Schlagwörter	Natural Language Processing; Computer Assisted Testing; Grading; Electronic Publishing; Books; Reading Motivation; Reading Comprehension; Computer Science Education; Graduate Students; Foreign Countries; Slovenia + Suchen Sie Ihr Suchwort? Natürliche Sprache; Notengebung; Schulnote; Elektronisches Publizieren; Book; Buch; Monographie; Monografie; Lesemotivation; Leseverstehen; Computer science lessons; Informatikunterricht; Graduate Study; Student; Students; Aufbaustudium; Graduiertenstudium; Hauptstudium; Studentin; Ausland; Slowenien
Abstract	We investigated how Natural Language Processing (NLP) algorithms could automatically grade answers to open-ended inference questions in web-based eBooks. This is a component of research on making reading more motivating to children and to increasing their comprehension. We obtained and graded a set of answers to open-ended questions embedded in a fiction novel written in English. Computer science students used a subset of the graded answers to develop algorithms designed to grade new answers to the questions. The algorithms utilized the story text, existing graded answers for a given question and publicly accessible databases in grading new responses. A computer science professor used another subset of the graded answers to evaluate the students' NLP algorithms and to select the best algorithm. The results showed that the best algorithm correctly graded approximately 85% of the real-world answers as correct, partly correct, or wrong. The best NLP algorithm was trained with questions and graded answers from a series of new text narratives in another language, Slovenian. The resulting NLP algorithm model was successfully used in fourth-grade language arts classes for providing feedback to student answers on open-ended questions in eBooks. (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01