The Rashomon Effect: Which Features of a Speaker's Talk Do Listeners Notice?

Autor/inn/en	Seedhouse, Paul; Satar, Müge
Titel	The Rashomon Effect: Which Features of a Speaker's Talk Do Listeners Notice?
Quelle	In: Classroom Discourse, 14 (2023) 1, S.1-23 (23 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1946-3014
DOI	10.1080/19463014.2021.1923540
Schlagwörter	Language Tests; English (Second Language); Second Language Learning; Oral Language; Interrater Reliability; Research Design; Grading; Video Technology; Scoring; Convergent Thinking; Observation; Recall (Psychology); International English Language Testing System + Suchen Sie Ihr Suchwort? Language test; Sprachtest; English as second language; English; Second Language; Englisch als Zweitsprache; Zweitsprachenerwerb; Oral interpretation; Mündlicher Sprachgebrauch; Interrater-Reliabilität; Forschungsdesign; Notengebung; Schulnote; Bewertung; Beobachtung; Abberufung; Language tests; Englisch
Abstract	The same L2 speaking performance may be analysed and evaluated in very different ways by different teachers or raters. We present a new, technology-assisted research design which opens up to investigation the trajectories of convergence and divergence between raters. We tracked and recorded what different raters noticed when, whilst grading a speaker's videoed talk in the IELTS Speaking Test. We devised graphs of the 'noticing trajectories' of raters to compare the relative degrees of convergence and divergence between all raters at any point. The possible reasons for convergence/divergence were elicited using stimulated recall interviews. We found that raters' noticing and rating tended to converge in relation to easily identifiable features such as idioms. However, for some stretches of speaker talk, there was clear divergence in terms of features noticed and rated by raters; in real IELTS tests, a background score-monitoring system deals with divergence. The research design enables delicate depiction of how the process of rater convergence/divergence unfolds over time. Applications are suggested in terms of examiner training, as well as for classroom discourse research and CA data workshops. (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01