Low-Stakes Performance Testing in Germany by the VERA Assessment: Analysis of the Mode Effects between Computer-Based Testing and Paper-Pencil Testing

Autor/inn/en	Wagner, Inga; Loesche, Philipp; Bißantz, Steven
Titel	Low-Stakes Performance Testing in Germany by the VERA Assessment: Analysis of the Mode Effects between Computer-Based Testing and Paper-Pencil Testing
Quelle	In: European Journal of Psychology of Education, 37 (2022) 2, S.531-549 (19 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Wagner, Inga)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0256-2928
DOI	10.1007/s10212-021-00532-6
Schlagwörter	Foreign Countries; Computer Assisted Testing; Evaluation Methods; Gender Differences; Academic Achievement; Grade 8; Scores; Oral Language; Germany + Suchen Sie Ihr Suchwort? Ausland; Geschlechterkonflikt; Schulleistung; School year 08; 8. Schuljahr; Schuljahr 08; Oral interpretation; Mündlicher Sprachgebrauch; Deutschland
Abstract	The German school system employs centrally organized performance assessments (some of which are called "VERA") as a way of promoting lesson development. In recent years, several German federal states introduced a computer-based performance testing system which will replace the paper-pencil testing system in the future. Scores from computer-based testing are required to be equivalent to paper-pencil testing scores so that the new testing medium does not lead to disadvantages for students. Therefore, the current study aimed at investigating the size of the mode effect and the moderating impact of students' gender, academic achievement and mainly spoken language in everyday life. In addition, the variance of the mode effect across tasks was investigated. The study was conducted in four German federal states in 2019 using a field experimental design. The test scores of 5140 eighth-graders from 165 schools in the subject German were analysed. The results of multi-level modelling revealed that students' test scores in the computerized version of the VERA test were significantly lower than in the paper-pencil version. Students with a lower academic achievement were more disadvantaged by the VERA computerized test. The results were inconsistent regarding the interactions between testing mode and students' gender and mainly spoken language in everyday life. The variance of the mode effect across tasks was high. Research into different subjects and in other federal states and countries under different testing conditions might yield further evidence about the generalizability of these results. (As Provided).
Anmerkungen	Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01