Model-Based Reinforcement Learning under Concurrent Schedules of Reinforcement in Rodents

Autor/inn/en	Huh, Namjung; Jo, Suhyun; Kim, Hoseok; Sul, Jung Hoon; Jung, Min Whan
Titel	Model-Based Reinforcement Learning under Concurrent Schedules of Reinforcement in Rodents
Quelle	In: Learning & Memory, 16 (2009) 5, S.315-323 (9 Seiten) PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1072-0502
DOI	10.1101/lm.1295509
Schlagwörter	Learning Theories; Animals; Rewards; Probability; Reinforcement; Learning Processes; Task Analysis; Behavior Patterns; Decision Making; Models + Suchen Sie Ihr Suchwort? Learning theory; Lerntheorie; Animal; Tier; Tiere; Reward; Belohnung; Wahrscheinlichkeitsrechnung; Wahrscheinlichkeitstheorie; Positive Verstärkung; Learning process; Lernprozess; Aufgabenanalyse; Decision-making; Entscheidungsfindung; Analogiemodell
Abstract	Reinforcement learning theories postulate that actions are chosen to maximize a long-term sum of positive outcomes based on value functions, which are subjective estimates of future rewards. In simple reinforcement learning algorithms, value functions are updated only by trial-and-error, whereas they are updated according to the decision-maker's knowledge or model of the environment in model-based reinforcement learning algorithms. To investigate how animals update value functions, we trained rats under two different free-choice tasks. The reward probability of the unchosen target remained unchanged in one task, whereas it increased over time since the target was last chosen in the other task. The results show that goal choice probability increased as a function of the number of consecutive alternative choices in the latter, but not the former task, indicating that the animals were aware of time-dependent increases in arming probability and used this information in choosing goals. In addition, the choice behavior in the latter task was better accounted for by a model-based reinforcement learning algorithm. Our results show that rats adopt a decision-making process that cannot be accounted for by simple reinforcement learning models even in a relatively simple binary choice task, suggesting that rats can readily improve their decision-making strategy through the knowledge of their environments. (Contains 8 figures and 2 tables.) (As Provided).
Anmerkungen	Cold Spring Harbor Laboratory Press. 500 Sunnyside Boulevard, Woodbury, NY 11797-2924. Tel: 800-843-4388; Tel: 516-367-8800; Fax: 516-422-4097; e-mail: cshpres@cshl.edu; Web site: http://www.learnmem.org/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10