A neural computational model of incentive salience

• Published in: PLoS computational biology 2009-07, Vol.5 (7), p.e1000437-e1000437
• Main Authors: Zhang, Jun, Berridge, Kent C, Tindell, Amy J, Smith, Kyle S, Aldridge, J Wayne
• Format: Article
• Language: English
• Subjects: Algorithms; Animals; Appetite - physiology; Behavior; Behavior, Animal - physiology; Brain - physiology; Brain research; Computer simulation; Computer-generated environments; Conditioning, Classical - physiology; Dopamine - physiology; Food; Hunger; Incentive (Psychology); Learning - physiology; Limbic System - physiology; Methods; Models, Neurological; Motivation; Neuroscience/Behavioral Neuroscience; Neuroscience/Cognitive Neuroscience; Neuroscience/Neural Homeostasis; Neuroscience/Psychology; Neuroscience/Theoretical Neuroscience; Rats; Reward; Salt
• ISSN: 1553-7358; 1553-734X; 1553-7358
• DOI: 10.1371/journal.pcbi.1000437

Incentive salience is a motivational property with 'magnet-like' qualities. When attributed to reward-predicting stimuli (cues), incentive salience triggers a pulse of 'wanting' and an individual is pulled toward the cues and reward. A key computational question is how incentive salience is generated during a cue re-encounter, which combines both learning and the state of limbic brain mechanisms. Learning processes, such as temporal-difference models, provide one way for stimuli to acquire cached predictive values of rewards. However, empirical data show that subsequent incentive values are also modulated on the fly by dynamic fluctuation in physiological states, altering cached values in ways requiring additional motivation mechanisms. Dynamic modulation of incentive salience for a Pavlovian conditioned stimulus (CS or cue) occurs during certain states, without necessarily requiring (re)learning about the cue. In some cases, dynamic modulation of cue value occurs during states that are quite novel, never having been experienced before, and even prior to experience of the associated unconditioned reward in the new state. Such cases can include novel drug-induced mesolimbic activation and addictive incentive-sensitization, as well as natural appetite states such as salt appetite. Dynamic enhancement specifically raises the incentive salience of an appropriate CS, without necessarily changing that of other CSs. Here we suggest a new computational model that modulates incentive salience by integrating changing physiological states with prior learning. We support the model with behavioral and neurobiological data from empirical tests that demonstrate dynamic elevations in cue-triggered motivation (involving natural salt appetite, and drug-induced intoxication and sensitization). Our data call for a dynamic model of incentive salience, such as presented here. Computational models can adequately capture fluctuations in cue-triggered 'wanting' only by incorporating modulation of previously learned values by natural appetite and addiction-related states.