Literaturnachweis - Detailanzeige
| Autor/inn/en | Hartmann, Stefan; Güzel, Emre; Gschwendtner, Tobias |
|---|---|
| Titel | Digital Measurement of Hands-On Performance? Ecological Validation of a Computer-Based Assessment of Automotive Repair Skills |
| Quelle | In: Empirical Research in Vocational Education and Training, 15 (2023), Artikel 15 (21 Seiten)Infoseite zur Zeitschrift
PDF als Volltext |
| Zusatzinformation | ORCID (Hartmann, Stefan) |
| Sprache | englisch |
| Dokumenttyp | gedruckt; online; Zeitschriftenaufsatz |
| DOI | 10.1186/s40461-023-00153-x |
| Schlagwörter | Performance Based Assessment; Computer Assisted Testing; Auto Mechanics; Job Skills; Equipment Maintenance; Motor Vehicles; Vocational Education; Video Technology; Scores; Test Validity; Test Interpretation; Ecology; Experiential Learning; Psychometrics |
| Abstract | We investigated the ecological validity of performance measures from a computer-based assessment tool that utilises scripted video vignettes. The intended purpose of this tool is to assess the maintenance and repair skills of automotive technician apprentices, complementing traditional hands-on assessment formats from the German journeymen's exams. We hypothesise that the ability to correctly judge repair actions shown in videos is a good predictor of the ability to perform corresponding actions in hands-on scenarios. Apprentices in the third year of vocational training carried out repairs on real cars or car systems, while experts rated their performance. After this, they worked on our computer-based tests, which utilise videos of very similar repairs. The correlation between video judgement and hands-on performance was lower than expected for most repair actions as well as for overall scores, indicating insufficient ecological validity of the test score interpretations. However, the findings are promising for developing future tests, as the results for some repair actions indicate it is generally possible to develop ecologically valid video-based items focusing on hands-on skills. We discuss the results in the light of a validation framework that combines validity evidence from different sources for the same assessment tool. Finally, we hope our findings contribute to a broader discussion about the psychometric quality of exams. (As Provided). |
| Anmerkungen | Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/ |
| Erfasst von | ERIC (Education Resources Information Center), Washington, DC |
| Update | 2024/1/01 |
Literaturbeschaffung und Bestandsnachweise in Bibliotheken prüfen
Permalink als QR-Code
Inhalt auf sozialen Plattformen teilen (nur vorhanden, wenn Javascript eingeschaltet ist)
Teile diese Seite:
