Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons

Uncertainty is critical in the measure of information and in assessing the accuracy of predictions. It is determined by probability P, being maximal at P = 0.5 and decreasing at higher and lower probabilities. Using distinct stimuli to indicate the probability of reward, we found that the phasic act...

Full description

Saved in:
Bibliographic Details
Published in:Science (American Association for the Advancement of Science) 2003-03, Vol.299 (5614), p.1898-1902
Main Authors: Fiorillo, Christopher D., Tobler, Philippe N., Schultz, Wolfram
Format: Article
Language:English
Subjects:
Analysis
Animals
Associative learning
Attention
Behavior
Behavioral neuroscience
Behavioral psychophysiology
Biological and medical sciences
Brain
Coding
Conditioning, Classical
Correlation
Discrimination (Psychology)
Dopamine
Dopamine - physiology
Electrophysiology
Feedback (Response)
Female
Fundamental and applied biological sciences. Psychology
Histograms
Learning
Linear Models
Macaca fascicularis
Mental stimulation
Mesencephalon - cytology
Mesencephalon - physiology
Motivation
Neurology
Neurons
Neurons - physiology
Neurosciences
Neurotransmission and behavior
Photic Stimulation
Physiological aspects
Probability
Probability learning
Propagation delay
Psychology. Psychoanalysis. Psychiatry
Psychology. Psychophysiology
Reinforcement (Psychology)
Reward
Risk-Taking
Scientific Concepts
Statistical Analysis
Stimuli
Uncertainty
Visual stimulation
Visual Stimuli
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Uncertainty is critical in the measure of information and in assessing the accuracy of predictions. It is determined by probability P, being maximal at P = 0.5 and decreasing at higher and lower probabilities. Using distinct stimuli to indicate the probability of reward, we found that the phasic activation of dopamine neurons varied monotonically across the full range of probabilities, supporting past claims that this response codes the discrepancy between predicted and actual reward. In contrast, a previously unobserved response covaried with uncertainty and consisted of a gradual increase in activity until the potential time of reward. The coding of uncertainty suggests a possible role for dopamine signals in attention-based learning and risk-taking behavior.
ISSN:0036-8075
1095-9203
DOI:10.1126/science.1077349