Loading…

Computational heterogeneity in the human mesencephalic dopamine system

Recent evidence in animals has indicated that the mesencephalic dopamine system is heterogeneous anatomically, molecularly, and functionally, and it has been suggested that the dopamine system comprises distinct functional systems. Identifying and characterizing these systems in humans will have wid...

Full description

Saved in:
Bibliographic Details
Published in:Cognitive, affective, & behavioral neuroscience affective, & behavioral neuroscience, 2013-12, Vol.13 (4), p.747-756
Main Authors: D’Ardenne, Kimberlee, Lohrenz, Terry, Bartley, Krystle A., Montague, P. Read
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c503t-63b60c1bb130d5074e2d2c324042f4de75ad57b1ca42258b5ef5b777960e21893
cites cdi_FETCH-LOGICAL-c503t-63b60c1bb130d5074e2d2c324042f4de75ad57b1ca42258b5ef5b777960e21893
container_end_page 756
container_issue 4
container_start_page 747
container_title Cognitive, affective, & behavioral neuroscience
container_volume 13
creator D’Ardenne, Kimberlee
Lohrenz, Terry
Bartley, Krystle A.
Montague, P. Read
description Recent evidence in animals has indicated that the mesencephalic dopamine system is heterogeneous anatomically, molecularly, and functionally, and it has been suggested that the dopamine system comprises distinct functional systems. Identifying and characterizing these systems in humans will have widespread ramifications for understanding drug addiction and mental health disorders. Model-based studies in humans have suggested an analogous computational heterogeneity, in which dopaminergic targets in striatum encode both experience-based learning signals and counterfactual learning signals that are based on hypothetical information. We used brainstem-tailored fMRI to identify mesencephalic sources of experiential and counterfactual learning signals. Participants completed a decision-making task based on investing in markets. This sequential investment task generated experience-based learning signals, in the form of temporal difference (TD) reward prediction errors, and counterfactual learning signals, in the form of “fictive errors.” Fictive errors are reinforcement learning signals based on hypothetical information about “what could have been.” An additional learning signal was constructed to be relatable to a motivational salience signal. Blood oxygenation level dependent responses in regions of substantia nigra (SN) and ventral tegmental area (VTA), where dopamine neurons are located, coded for TD and fictive errors, and additionally were related to the motivational salience signal. These results are highly consistent with animal electrophysiology and provide direct evidence that human SN and VTA heterogeneously handle important reward-harvesting computations.
doi_str_mv 10.3758/s13415-013-0191-5
format article
fullrecord <record><control><sourceid>proquest_pubme</sourceid><recordid>TN_cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_3889258</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>1500760875</sourcerecordid><originalsourceid>FETCH-LOGICAL-c503t-63b60c1bb130d5074e2d2c324042f4de75ad57b1ca42258b5ef5b777960e21893</originalsourceid><addsrcrecordid>eNqFkU9rFDEYh4MotlY_gBcZ8OJl9M2_ycxFkMWqUPBiobeQyby7kzKTjEmmsN_ebLeWKpQeQgJ58ssveQh5S-EjV7L9lCgXVNZAeRkdreUzckolpzXl8ur57RpqBaw5Ia9SugYAwQR7SU4Y7wSXlJ2S802YlzWb7II3UzVixhh26NHlfeV8lUesxnU2vpoxobe4jGZythrCYmbnsUr7lHF-TV5szZTwzd18Ri7Pv_7afK8vfn77sflyUVsJPNcN7xuwtO8ph0GCEsgGZjkTpdhWDKikGaTqqTWCMdn2EreyV0p1DSCjbcfPyOdj7rL2Mw4WfY5m0kt0s4l7HYzT_-54N-pduNG8bbuSWAI-3AXE8HvFlPXsksVpMh7DmjSVAKqBVsmnUaGUbEBxUdD3_6HXYY3lQ28pCrKYOJSnR8rGkFLE7X1vCvogVB-F6iJUH4TqQ4l3Dx98f-KvwQKwI5DKlt9hfHD1o6l_AH1Lqzs</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1471051539</pqid></control><display><type>article</type><title>Computational heterogeneity in the human mesencephalic dopamine system</title><source>Springer Link</source><creator>D’Ardenne, Kimberlee ; Lohrenz, Terry ; Bartley, Krystle A. ; Montague, P. Read</creator><creatorcontrib>D’Ardenne, Kimberlee ; Lohrenz, Terry ; Bartley, Krystle A. ; Montague, P. Read</creatorcontrib><description>Recent evidence in animals has indicated that the mesencephalic dopamine system is heterogeneous anatomically, molecularly, and functionally, and it has been suggested that the dopamine system comprises distinct functional systems. Identifying and characterizing these systems in humans will have widespread ramifications for understanding drug addiction and mental health disorders. Model-based studies in humans have suggested an analogous computational heterogeneity, in which dopaminergic targets in striatum encode both experience-based learning signals and counterfactual learning signals that are based on hypothetical information. We used brainstem-tailored fMRI to identify mesencephalic sources of experiential and counterfactual learning signals. Participants completed a decision-making task based on investing in markets. This sequential investment task generated experience-based learning signals, in the form of temporal difference (TD) reward prediction errors, and counterfactual learning signals, in the form of “fictive errors.” Fictive errors are reinforcement learning signals based on hypothetical information about “what could have been.” An additional learning signal was constructed to be relatable to a motivational salience signal. Blood oxygenation level dependent responses in regions of substantia nigra (SN) and ventral tegmental area (VTA), where dopamine neurons are located, coded for TD and fictive errors, and additionally were related to the motivational salience signal. These results are highly consistent with animal electrophysiology and provide direct evidence that human SN and VTA heterogeneously handle important reward-harvesting computations.</description><identifier>ISSN: 1530-7026</identifier><identifier>EISSN: 1531-135X</identifier><identifier>DOI: 10.3758/s13415-013-0191-5</identifier><identifier>PMID: 23943512</identifier><language>eng</language><publisher>Boston: Springer US</publisher><subject>Adult ; Behavioral Science and Psychology ; Blood ; Cognitive Psychology ; Computer Simulation ; Decision Making - physiology ; Dopamine - metabolism ; Female ; Humans ; Image Processing, Computer-Assisted ; Learning - physiology ; Magnetic Resonance Imaging ; Male ; Mesencephalon - blood supply ; Mesencephalon - physiology ; Middle Aged ; Models, Neurological ; Neurosciences ; Oxygen - blood ; Psychology ; Young Adult</subject><ispartof>Cognitive, affective, &amp; behavioral neuroscience, 2013-12, Vol.13 (4), p.747-756</ispartof><rights>The Author(s) 2013</rights><rights>Copyright Springer Science &amp; Business Media Dec 2013</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c503t-63b60c1bb130d5074e2d2c324042f4de75ad57b1ca42258b5ef5b777960e21893</citedby><cites>FETCH-LOGICAL-c503t-63b60c1bb130d5074e2d2c324042f4de75ad57b1ca42258b5ef5b777960e21893</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>230,314,780,784,885,27924,27925</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/23943512$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>D’Ardenne, Kimberlee</creatorcontrib><creatorcontrib>Lohrenz, Terry</creatorcontrib><creatorcontrib>Bartley, Krystle A.</creatorcontrib><creatorcontrib>Montague, P. Read</creatorcontrib><title>Computational heterogeneity in the human mesencephalic dopamine system</title><title>Cognitive, affective, &amp; behavioral neuroscience</title><addtitle>Cogn Affect Behav Neurosci</addtitle><addtitle>Cogn Affect Behav Neurosci</addtitle><description>Recent evidence in animals has indicated that the mesencephalic dopamine system is heterogeneous anatomically, molecularly, and functionally, and it has been suggested that the dopamine system comprises distinct functional systems. Identifying and characterizing these systems in humans will have widespread ramifications for understanding drug addiction and mental health disorders. Model-based studies in humans have suggested an analogous computational heterogeneity, in which dopaminergic targets in striatum encode both experience-based learning signals and counterfactual learning signals that are based on hypothetical information. We used brainstem-tailored fMRI to identify mesencephalic sources of experiential and counterfactual learning signals. Participants completed a decision-making task based on investing in markets. This sequential investment task generated experience-based learning signals, in the form of temporal difference (TD) reward prediction errors, and counterfactual learning signals, in the form of “fictive errors.” Fictive errors are reinforcement learning signals based on hypothetical information about “what could have been.” An additional learning signal was constructed to be relatable to a motivational salience signal. Blood oxygenation level dependent responses in regions of substantia nigra (SN) and ventral tegmental area (VTA), where dopamine neurons are located, coded for TD and fictive errors, and additionally were related to the motivational salience signal. These results are highly consistent with animal electrophysiology and provide direct evidence that human SN and VTA heterogeneously handle important reward-harvesting computations.</description><subject>Adult</subject><subject>Behavioral Science and Psychology</subject><subject>Blood</subject><subject>Cognitive Psychology</subject><subject>Computer Simulation</subject><subject>Decision Making - physiology</subject><subject>Dopamine - metabolism</subject><subject>Female</subject><subject>Humans</subject><subject>Image Processing, Computer-Assisted</subject><subject>Learning - physiology</subject><subject>Magnetic Resonance Imaging</subject><subject>Male</subject><subject>Mesencephalon - blood supply</subject><subject>Mesencephalon - physiology</subject><subject>Middle Aged</subject><subject>Models, Neurological</subject><subject>Neurosciences</subject><subject>Oxygen - blood</subject><subject>Psychology</subject><subject>Young Adult</subject><issn>1530-7026</issn><issn>1531-135X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2013</creationdate><recordtype>article</recordtype><recordid>eNqFkU9rFDEYh4MotlY_gBcZ8OJl9M2_ycxFkMWqUPBiobeQyby7kzKTjEmmsN_ebLeWKpQeQgJ58ssveQh5S-EjV7L9lCgXVNZAeRkdreUzckolpzXl8ur57RpqBaw5Ia9SugYAwQR7SU4Y7wSXlJ2S802YlzWb7II3UzVixhh26NHlfeV8lUesxnU2vpoxobe4jGZythrCYmbnsUr7lHF-TV5szZTwzd18Ri7Pv_7afK8vfn77sflyUVsJPNcN7xuwtO8ph0GCEsgGZjkTpdhWDKikGaTqqTWCMdn2EreyV0p1DSCjbcfPyOdj7rL2Mw4WfY5m0kt0s4l7HYzT_-54N-pduNG8bbuSWAI-3AXE8HvFlPXsksVpMh7DmjSVAKqBVsmnUaGUbEBxUdD3_6HXYY3lQ28pCrKYOJSnR8rGkFLE7X1vCvogVB-F6iJUH4TqQ4l3Dx98f-KvwQKwI5DKlt9hfHD1o6l_AH1Lqzs</recordid><startdate>20131201</startdate><enddate>20131201</enddate><creator>D’Ardenne, Kimberlee</creator><creator>Lohrenz, Terry</creator><creator>Bartley, Krystle A.</creator><creator>Montague, P. Read</creator><general>Springer US</general><general>Springer Nature B.V</general><scope>C6C</scope><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>4T-</scope><scope>4U-</scope><scope>7RV</scope><scope>7TK</scope><scope>7X7</scope><scope>7XB</scope><scope>88E</scope><scope>88G</scope><scope>8AO</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>GNUQQ</scope><scope>K9.</scope><scope>M0S</scope><scope>M1P</scope><scope>M2M</scope><scope>NAPCQ</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PSYQQ</scope><scope>Q9U</scope><scope>7X8</scope><scope>5PM</scope></search><sort><creationdate>20131201</creationdate><title>Computational heterogeneity in the human mesencephalic dopamine system</title><author>D’Ardenne, Kimberlee ; Lohrenz, Terry ; Bartley, Krystle A. ; Montague, P. Read</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c503t-63b60c1bb130d5074e2d2c324042f4de75ad57b1ca42258b5ef5b777960e21893</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2013</creationdate><topic>Adult</topic><topic>Behavioral Science and Psychology</topic><topic>Blood</topic><topic>Cognitive Psychology</topic><topic>Computer Simulation</topic><topic>Decision Making - physiology</topic><topic>Dopamine - metabolism</topic><topic>Female</topic><topic>Humans</topic><topic>Image Processing, Computer-Assisted</topic><topic>Learning - physiology</topic><topic>Magnetic Resonance Imaging</topic><topic>Male</topic><topic>Mesencephalon - blood supply</topic><topic>Mesencephalon - physiology</topic><topic>Middle Aged</topic><topic>Models, Neurological</topic><topic>Neurosciences</topic><topic>Oxygen - blood</topic><topic>Psychology</topic><topic>Young Adult</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>D’Ardenne, Kimberlee</creatorcontrib><creatorcontrib>Lohrenz, Terry</creatorcontrib><creatorcontrib>Bartley, Krystle A.</creatorcontrib><creatorcontrib>Montague, P. Read</creatorcontrib><collection>SpringerOpen</collection><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Docstoc</collection><collection>University Readers</collection><collection>Nursing &amp; Allied Health Database</collection><collection>Neurosciences Abstracts</collection><collection>Health &amp; Medical Collection (Proquest)</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Medical Database (Alumni Edition)</collection><collection>Psychology Database (Alumni)</collection><collection>ProQuest Pharma Collection</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Central Student</collection><collection>ProQuest Health &amp; Medical Complete (Alumni)</collection><collection>Health &amp; Medical Collection (Alumni Edition)</collection><collection>PML(ProQuest Medical Library)</collection><collection>Psychology Database (ProQuest)</collection><collection>Nursing &amp; Allied Health Premium</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest One Psychology</collection><collection>ProQuest Central Basic</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><jtitle>Cognitive, affective, &amp; behavioral neuroscience</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>D’Ardenne, Kimberlee</au><au>Lohrenz, Terry</au><au>Bartley, Krystle A.</au><au>Montague, P. Read</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Computational heterogeneity in the human mesencephalic dopamine system</atitle><jtitle>Cognitive, affective, &amp; behavioral neuroscience</jtitle><stitle>Cogn Affect Behav Neurosci</stitle><addtitle>Cogn Affect Behav Neurosci</addtitle><date>2013-12-01</date><risdate>2013</risdate><volume>13</volume><issue>4</issue><spage>747</spage><epage>756</epage><pages>747-756</pages><issn>1530-7026</issn><eissn>1531-135X</eissn><abstract>Recent evidence in animals has indicated that the mesencephalic dopamine system is heterogeneous anatomically, molecularly, and functionally, and it has been suggested that the dopamine system comprises distinct functional systems. Identifying and characterizing these systems in humans will have widespread ramifications for understanding drug addiction and mental health disorders. Model-based studies in humans have suggested an analogous computational heterogeneity, in which dopaminergic targets in striatum encode both experience-based learning signals and counterfactual learning signals that are based on hypothetical information. We used brainstem-tailored fMRI to identify mesencephalic sources of experiential and counterfactual learning signals. Participants completed a decision-making task based on investing in markets. This sequential investment task generated experience-based learning signals, in the form of temporal difference (TD) reward prediction errors, and counterfactual learning signals, in the form of “fictive errors.” Fictive errors are reinforcement learning signals based on hypothetical information about “what could have been.” An additional learning signal was constructed to be relatable to a motivational salience signal. Blood oxygenation level dependent responses in regions of substantia nigra (SN) and ventral tegmental area (VTA), where dopamine neurons are located, coded for TD and fictive errors, and additionally were related to the motivational salience signal. These results are highly consistent with animal electrophysiology and provide direct evidence that human SN and VTA heterogeneously handle important reward-harvesting computations.</abstract><cop>Boston</cop><pub>Springer US</pub><pmid>23943512</pmid><doi>10.3758/s13415-013-0191-5</doi><tpages>10</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1530-7026
ispartof Cognitive, affective, & behavioral neuroscience, 2013-12, Vol.13 (4), p.747-756
issn 1530-7026
1531-135X
language eng
recordid cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_3889258
source Springer Link
subjects Adult
Behavioral Science and Psychology
Blood
Cognitive Psychology
Computer Simulation
Decision Making - physiology
Dopamine - metabolism
Female
Humans
Image Processing, Computer-Assisted
Learning - physiology
Magnetic Resonance Imaging
Male
Mesencephalon - blood supply
Mesencephalon - physiology
Middle Aged
Models, Neurological
Neurosciences
Oxygen - blood
Psychology
Young Adult
title Computational heterogeneity in the human mesencephalic dopamine system
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-24T13%3A57%3A33IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_pubme&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Computational%20heterogeneity%20in%20the%20human%20mesencephalic%20dopamine%20system&rft.jtitle=Cognitive,%20affective,%20&%20behavioral%20neuroscience&rft.au=D%E2%80%99Ardenne,%20Kimberlee&rft.date=2013-12-01&rft.volume=13&rft.issue=4&rft.spage=747&rft.epage=756&rft.pages=747-756&rft.issn=1530-7026&rft.eissn=1531-135X&rft_id=info:doi/10.3758/s13415-013-0191-5&rft_dat=%3Cproquest_pubme%3E1500760875%3C/proquest_pubme%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c503t-63b60c1bb130d5074e2d2c324042f4de75ad57b1ca42258b5ef5b777960e21893%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=1471051539&rft_id=info:pmid/23943512&rfr_iscdi=true