Effects of Text Length on Lexical Diversity Measures: Using Short Texts with Less than 200 Tokens

Autor/inn/en	Koizumi, Rie; In'nami, Yo
Titel	Effects of Text Length on Lexical Diversity Measures: Using Short Texts with Less than 200 Tokens
Quelle	In: System: An International Journal of Educational Technology and Applied Linguistics, 40 (2012) 4, S.554-564 (11 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0346-251X
DOI	10.1016/j.system.2012.10.012
Schlagwörter	Second Language Learning; Measurement Techniques; Robustness (Statistics); Evaluation Methods; English (Second Language); Language Tests; Comparative Analysis; Vocabulary; Speech Communication + Suchen Sie Ihr Suchwort? Zweitsprachenerwerb; Messtechnik; Widerstandsfähigkeit; English as second language; English; Second Language; Englisch als Zweitsprache; Language test; Sprachtest; Wortschatz
Abstract	Despite the importance of lexical diversity (LD) in L2 speaking and writing performance, LD assessment measures are known to be affected by the number of words analyzed in the text. This study aims to identify LD measures that are least affected by text length and can be used for the analysis of short L2 texts (50-200 tokens). We compared the type-token ratio, Guiraud index, Maas, measure of textual lexical diversity (MTLD), D, and HD-D to assess their robustness in relation to text length variation. Spoken texts of 200 tokens from 38 L2 English learners at the lower-intermediate-level were divided into segments of 50-200 tokens and the text length impact was examined. We found that MTLD was least affected by text length across most ranges, but was somewhat affected across 50-150 and 50-200 tokens. We further observed low correlations between equal-sized texts for up to 100 tokens. These results suggest that MTLD can be used with texts of more than 100 tokens and MTLD values can be compared between texts across 100 and 200 tokens. We also showed that D and HD-D produced similar results for texts; this indicates that D and HD-D are comparable. (Contains 3 tables and 1 figure.) (As Provided).
Anmerkungen	Elsevier. 6277 Sea Harbor Drive, Orlando, FL 32887-4800. Tel: 877-839-7126; Tel: 407-345-4020; Fax: 407-363-1354; e-mail: usjcs@elsevier.com; Web site: http://www.elsevier.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10