TD models of reward predictive responses in dopamine neurons

This article focuses on recent modeling studies of dopamine neuron activity and their influence on behavior. Activity of midbrain dopamine neurons is phasically increased by stimuli that increase the animal's reward expectation and is decreased below baseline levels when the reward fails to occ...

Full description

Saved in:
Bibliographic Details
Published in:Neural networks 2002-06, Vol.15 (4), p.523-533
Main Author: Suri, Roland E.
Format: Article
Language:English
Subjects:
Animals
Dopamine - physiology
Forecasting - methods
Humans
Models, Biological
Neuromodulation
Neurons - physiology
Planning
Prediction
Reinforcement
Reward
Sensorimotor
Temporal difference
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This article focuses on recent modeling studies of dopamine neuron activity and their influence on behavior. Activity of midbrain dopamine neurons is phasically increased by stimuli that increase the animal's reward expectation and is decreased below baseline levels when the reward fails to occur. These characteristics resemble the reward prediction error signal of the temporal difference (TD) model, which is a model of reinforcement learning. Computational modeling studies show that such a dopamine-like reward prediction error can serve as a powerful teaching signal for learning with delayed reinforcement, in particular for learning of motor sequences. Several lines of evidence suggest that dopamine is also involved in ‘cognitive’ processes that are not addressed by standard TD models. I propose the hypothesis that dopamine neuron activity is crucial for planning processes, also referred to as ‘goal-directed behavior’, which select actions by evaluating predictions about their motivational outcomes.
ISSN:0893-6080
1879-2782
DOI:10.1016/S0893-6080(02)00046-1