Zipfian Frequency Distributions Facilitate Word Segmentation in Context

Autor/inn/en	Kurumada, Chigusa; Meylan, Stephan C.; Frank, Michael C.
Titel	Zipfian Frequency Distributions Facilitate Word Segmentation in Context
Quelle	In: Cognition, 127 (2013) 3, S.439-453 (15 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0010-0277
DOI	10.1016/j.cognition.2013.02.002
Schlagwörter	Statistical Distributions; Word Frequency; Language Acquisition; Artificial Languages; Sentences; Computation; Models + Suchen Sie Ihr Suchwort? Wahrscheinlichkeitsverteilung; Word analysis; Frequency; Wortanalyse; Häufigkeit; Sprachaneignung; Spracherwerb; Sentence analysis; Satzanalyse; Analogiemodell
Abstract	Word frequencies in natural language follow a highly skewed Zipfian distribution, but the consequences of this distribution for language acquisition are only beginning to be understood. Typically, learning experiments that are meant to simulate language acquisition use uniform word frequency distributions. We examine the effects of Zipfian distributions using two artificial language paradigms--a standard forced-choice task and a new orthographic segmentation task in which participants click on the boundaries between words in contexts. Our data show that learners can identify word forms robustly across widely varying frequency distributions. In addition, although performance in recognizing individual words is predicted best by their frequency, a Zipfian distribution facilitates word segmentation in context: The presence of high-frequency words creates more chances for learners to apply their knowledge in processing new sentences. We find that computational models that implement "chunking" are more effective than "transition finding" models at reproducing this pattern of performance. (Contains 3 tables and 7 figures.) (As Provided).
Anmerkungen	Elsevier. 3251 Riverport Lane, Maryland Heights, MO 63043. Tel: 800-325-4177; Tel: 314-447-8000; Fax: 314-447-8033; e-mail: JournalCustomerService-usa@elsevier.com; Web site: http://www.elsevier.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10