Automated Assessment in Computer Science Education: A State-of-the-Art Review

Autor/inn/en	Paiva, José Carlos; Leal, José Paulo; Figueira, Álvaro
Titel	Automated Assessment in Computer Science Education: A State-of-the-Art Review
Quelle	In: ACM Transactions on Computing Education, 22 (2022) 3, Artikel 34 (41 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Paiva, José Carlos)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
Schlagwörter	Automation; Computer Assisted Testing; Student Evaluation; Computer Science Education; State of the Art Reviews; Assignments; Computer Security; Test Format; Feedback (Response) + Suchen Sie Ihr Suchwort? Schulnote; Studentische Bewertung; Computer science lessons; Informatikunterricht; Entwicklungsstand; Assignment; Auftrag; Zuweisung; Computervirus; Computersicherheit; Testentwicklung
Abstract	Practical programming competencies are critical to the success in computer science (CS) education and go-to-market of fresh graduates. Acquiring the required level of skills is a long journey of discovery, trial and error, and optimization seeking through a broad range of programming activities that learners must perform themselves. It is not reasonable to consider that teachers could evaluate all attempts that the average learner should develop multiplied by the number of students enrolled in a course, much less in a timely, deep, and fair fashion. Unsurprisingly, exploring the formal structure of programs to automate the assessment of certain features has long been a hot topic among CS education practitioners. Assessing a program is considerably more complex than asserting its functional correctness, as the proliferation of tools and techniques in the literature over the past decades indicates. Program efficiency, behavior, and readability, among many other features, assessed either statically or dynamically, are now also relevant for automatic evaluation. The outcome of an evaluation evolved from the primordial Boolean values to information about errors and tips on how to advance, possibly taking into account similar solutions. This work surveys the state of the art in the automated assessment of CS assignments, focusing on the supported types of exercises, security measures adopted, testing techniques used, type of feedback produced, and the information they offer the teacher to understand and optimize learning. A new era of automated assessment, capitalizing on static analysis techniques and containerization, has been identified. Furthermore, this review presents several other findings from the conducted review, discusses the current challenges of the field, and proposes some future research directions. (As Provided).
Anmerkungen	Association for Computing Machinery. 2 Penn Plaza Suite 701, New York, NY 10121. Tel: 800-342-6626; Tel: 212-626-0500; Fax: 212-944-1318; e-mail: acmhelp@acm.org; Web site: http://toce.acm.org/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01