Loading…

Networks of VTA Neurons Encode Real-Time Information about Uncertain Numbers of Actions Executed to Earn a Reward

Multiple and unpredictable numbers of actions are often required to achieve a goal. In order to organize behavior and allocate effort so that optimal behavioral policies can be selected, it is necessary to continually monitor ongoing actions. Real-time processing of information related to actions an...

Full description

Saved in:
Bibliographic Details
Published in:Frontiers in behavioral neuroscience 2017-08, Vol.11, p.140-140
Main Authors: Wood, Jesse, Simon, Nicholas W, Koerner, F Spencer, Kass, Robert E, Moghaddam, Bita
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c490t-b4048f5bbdea2a97dd601a5aad0f647b976044866fca5a541586257f359d1cec3
cites cdi_FETCH-LOGICAL-c490t-b4048f5bbdea2a97dd601a5aad0f647b976044866fca5a541586257f359d1cec3
container_end_page 140
container_issue
container_start_page 140
container_title Frontiers in behavioral neuroscience
container_volume 11
creator Wood, Jesse
Simon, Nicholas W
Koerner, F Spencer
Kass, Robert E
Moghaddam, Bita
description Multiple and unpredictable numbers of actions are often required to achieve a goal. In order to organize behavior and allocate effort so that optimal behavioral policies can be selected, it is necessary to continually monitor ongoing actions. Real-time processing of information related to actions and outcomes is typically assigned to the prefrontal cortex and basal ganglia, but also depends on midbrain regions, especially the ventral tegmental area (VTA). We were interested in how individual VTA neurons, as well as networks within the VTA, encode salient events when an unpredictable number of serial actions are required to obtain a reward. We recorded from ensembles of putative dopamine and non-dopamine neurons in the VTA as animals performed multiple cued trials in a recording session where, in each trial, serial actions were randomly rewarded. While averaging population activity did not reveal a response pattern, we observed that different neurons were selectively tuned to low, medium, or high numbered actions in a trial. This preferential tuning of putative dopamine and non-dopamine VTA neurons to different subsets of actions in a trial allowed information about binned action number to be decoded from the ensemble activity. At the network level, tuning curve similarity was positively associated with action-evoked noise correlations, suggesting that action number selectivity reflects functional connectivity within these networks. Analysis of phasic responses to cue and reward revealed that the requirement to execute multiple and uncertain numbers of actions weakens both cue-evoked responses and cue-reward response correlation. The functional connectivity and ensemble coding scheme that we observe here may allow VTA neurons to cooperatively provide a real-time account of ongoing behavior. These computations may be critical to cognitive and motivational functions that have long been associated with VTA dopamine neurons.
doi_str_mv 10.3389/fnbeh.2017.00140
format article
fullrecord <record><control><sourceid>proquest_doaj_</sourceid><recordid>TN_cdi_doaj_primary_oai_doaj_org_article_298f437e4c6f4a13854fd11d130cdb88</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><doaj_id>oai_doaj_org_article_298f437e4c6f4a13854fd11d130cdb88</doaj_id><sourcerecordid>1933604627</sourcerecordid><originalsourceid>FETCH-LOGICAL-c490t-b4048f5bbdea2a97dd601a5aad0f647b976044866fca5a541586257f359d1cec3</originalsourceid><addsrcrecordid>eNpdks9v0zAcxSMEYmNw54QsceGS4t9xLkjVVKDSVCTUcbUc--stJbE3x2Hw3-O2Y9o42fr6vY_87FdVbwleMKbajz50cL2gmDQLjAnHz6pTIiWtBRHs-aP9SfVqmnYYSyp587I6oUpxxbE6rW43kO9i-jmh6NGP7RJtYE4xTGgVbHSAvoMZ6m0_AloHH9Noch8DMl2cM7oMFlI2fUCbeewgHRhLu1cU_2-wcwaHckQrk4qnsO5Mcq-rF94ME7y5X8-qy8-r7fnX-uLbl_X58qK2vMW57jjmyouuc2CoaRvnJCZGGOOwLyG6tpGYcyWlt2UqOBFKUtF4JlpHLFh2Vq2PXBfNTt-kfjTpj46m14dBTFfapNzbATRtleesAW6l54YwJbh3hDjCsHWdUoX16ci6mbsRnIWQkxmeQJ-ehP5aX8VfWgiBG8oK4MM9IMXbGaasx36yMAwmQJwnTVrGSh5JmyJ9_590F-cUylNpStuWK1a-rqjwUWVTnKYE_uEyBOt9N_ShG3rfDX3oRrG8exziwfCvDOwv85G19Q</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2299483484</pqid></control><display><type>article</type><title>Networks of VTA Neurons Encode Real-Time Information about Uncertain Numbers of Actions Executed to Earn a Reward</title><source>Open Access: PubMed Central</source><source>Publicly Available Content Database</source><creator>Wood, Jesse ; Simon, Nicholas W ; Koerner, F Spencer ; Kass, Robert E ; Moghaddam, Bita</creator><creatorcontrib>Wood, Jesse ; Simon, Nicholas W ; Koerner, F Spencer ; Kass, Robert E ; Moghaddam, Bita</creatorcontrib><description>Multiple and unpredictable numbers of actions are often required to achieve a goal. In order to organize behavior and allocate effort so that optimal behavioral policies can be selected, it is necessary to continually monitor ongoing actions. Real-time processing of information related to actions and outcomes is typically assigned to the prefrontal cortex and basal ganglia, but also depends on midbrain regions, especially the ventral tegmental area (VTA). We were interested in how individual VTA neurons, as well as networks within the VTA, encode salient events when an unpredictable number of serial actions are required to obtain a reward. We recorded from ensembles of putative dopamine and non-dopamine neurons in the VTA as animals performed multiple cued trials in a recording session where, in each trial, serial actions were randomly rewarded. While averaging population activity did not reveal a response pattern, we observed that different neurons were selectively tuned to low, medium, or high numbered actions in a trial. This preferential tuning of putative dopamine and non-dopamine VTA neurons to different subsets of actions in a trial allowed information about binned action number to be decoded from the ensemble activity. At the network level, tuning curve similarity was positively associated with action-evoked noise correlations, suggesting that action number selectivity reflects functional connectivity within these networks. Analysis of phasic responses to cue and reward revealed that the requirement to execute multiple and uncertain numbers of actions weakens both cue-evoked responses and cue-reward response correlation. The functional connectivity and ensemble coding scheme that we observe here may allow VTA neurons to cooperatively provide a real-time account of ongoing behavior. These computations may be critical to cognitive and motivational functions that have long been associated with VTA dopamine neurons.</description><identifier>ISSN: 1662-5153</identifier><identifier>EISSN: 1662-5153</identifier><identifier>DOI: 10.3389/fnbeh.2017.00140</identifier><identifier>PMID: 28848408</identifier><language>eng</language><publisher>Switzerland: Frontiers Research Foundation</publisher><subject>assemblies ; Basal ganglia ; Behavior ; Cognitive ability ; Dopamine ; ensemble coding ; Food ; Information processing ; Laboratory animals ; Mesencephalon ; Neural coding ; Neural networks ; Neurons ; Neuroscience ; Prefrontal cortex ; Reinforcement ; Science ; serial actions ; ventral tegmental area ; Ventral tegmentum ; VTA</subject><ispartof>Frontiers in behavioral neuroscience, 2017-08, Vol.11, p.140-140</ispartof><rights>2017. This work is licensed under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>Copyright © 2017 Wood, Simon, Koerner, Kass and Moghaddam. 2017 Wood, Simon, Koerner, Kass and Moghaddam</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c490t-b4048f5bbdea2a97dd601a5aad0f647b976044866fca5a541586257f359d1cec3</citedby><cites>FETCH-LOGICAL-c490t-b4048f5bbdea2a97dd601a5aad0f647b976044866fca5a541586257f359d1cec3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.proquest.com/docview/2299483484/fulltextPDF?pq-origsite=primo$$EPDF$$P50$$Gproquest$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://www.proquest.com/docview/2299483484?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>230,314,727,780,784,885,25753,27924,27925,37012,37013,44590,53791,53793,75126</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/28848408$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Wood, Jesse</creatorcontrib><creatorcontrib>Simon, Nicholas W</creatorcontrib><creatorcontrib>Koerner, F Spencer</creatorcontrib><creatorcontrib>Kass, Robert E</creatorcontrib><creatorcontrib>Moghaddam, Bita</creatorcontrib><title>Networks of VTA Neurons Encode Real-Time Information about Uncertain Numbers of Actions Executed to Earn a Reward</title><title>Frontiers in behavioral neuroscience</title><addtitle>Front Behav Neurosci</addtitle><description>Multiple and unpredictable numbers of actions are often required to achieve a goal. In order to organize behavior and allocate effort so that optimal behavioral policies can be selected, it is necessary to continually monitor ongoing actions. Real-time processing of information related to actions and outcomes is typically assigned to the prefrontal cortex and basal ganglia, but also depends on midbrain regions, especially the ventral tegmental area (VTA). We were interested in how individual VTA neurons, as well as networks within the VTA, encode salient events when an unpredictable number of serial actions are required to obtain a reward. We recorded from ensembles of putative dopamine and non-dopamine neurons in the VTA as animals performed multiple cued trials in a recording session where, in each trial, serial actions were randomly rewarded. While averaging population activity did not reveal a response pattern, we observed that different neurons were selectively tuned to low, medium, or high numbered actions in a trial. This preferential tuning of putative dopamine and non-dopamine VTA neurons to different subsets of actions in a trial allowed information about binned action number to be decoded from the ensemble activity. At the network level, tuning curve similarity was positively associated with action-evoked noise correlations, suggesting that action number selectivity reflects functional connectivity within these networks. Analysis of phasic responses to cue and reward revealed that the requirement to execute multiple and uncertain numbers of actions weakens both cue-evoked responses and cue-reward response correlation. The functional connectivity and ensemble coding scheme that we observe here may allow VTA neurons to cooperatively provide a real-time account of ongoing behavior. These computations may be critical to cognitive and motivational functions that have long been associated with VTA dopamine neurons.</description><subject>assemblies</subject><subject>Basal ganglia</subject><subject>Behavior</subject><subject>Cognitive ability</subject><subject>Dopamine</subject><subject>ensemble coding</subject><subject>Food</subject><subject>Information processing</subject><subject>Laboratory animals</subject><subject>Mesencephalon</subject><subject>Neural coding</subject><subject>Neural networks</subject><subject>Neurons</subject><subject>Neuroscience</subject><subject>Prefrontal cortex</subject><subject>Reinforcement</subject><subject>Science</subject><subject>serial actions</subject><subject>ventral tegmental area</subject><subject>Ventral tegmentum</subject><subject>VTA</subject><issn>1662-5153</issn><issn>1662-5153</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2017</creationdate><recordtype>article</recordtype><sourceid>PIMPY</sourceid><sourceid>DOA</sourceid><recordid>eNpdks9v0zAcxSMEYmNw54QsceGS4t9xLkjVVKDSVCTUcbUc--stJbE3x2Hw3-O2Y9o42fr6vY_87FdVbwleMKbajz50cL2gmDQLjAnHz6pTIiWtBRHs-aP9SfVqmnYYSyp587I6oUpxxbE6rW43kO9i-jmh6NGP7RJtYE4xTGgVbHSAvoMZ6m0_AloHH9Noch8DMl2cM7oMFlI2fUCbeewgHRhLu1cU_2-wcwaHckQrk4qnsO5Mcq-rF94ME7y5X8-qy8-r7fnX-uLbl_X58qK2vMW57jjmyouuc2CoaRvnJCZGGOOwLyG6tpGYcyWlt2UqOBFKUtF4JlpHLFh2Vq2PXBfNTt-kfjTpj46m14dBTFfapNzbATRtleesAW6l54YwJbh3hDjCsHWdUoX16ci6mbsRnIWQkxmeQJ-ehP5aX8VfWgiBG8oK4MM9IMXbGaasx36yMAwmQJwnTVrGSh5JmyJ9_590F-cUylNpStuWK1a-rqjwUWVTnKYE_uEyBOt9N_ShG3rfDX3oRrG8exziwfCvDOwv85G19Q</recordid><startdate>20170808</startdate><enddate>20170808</enddate><creator>Wood, Jesse</creator><creator>Simon, Nicholas W</creator><creator>Koerner, F Spencer</creator><creator>Kass, Robert E</creator><creator>Moghaddam, Bita</creator><general>Frontiers Research Foundation</general><general>Frontiers Media S.A</general><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7QG</scope><scope>7QP</scope><scope>7QR</scope><scope>7TK</scope><scope>7XB</scope><scope>88I</scope><scope>8FD</scope><scope>8FE</scope><scope>8FH</scope><scope>8FK</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BBNVY</scope><scope>BENPR</scope><scope>BHPHI</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FR3</scope><scope>GNUQQ</scope><scope>HCIFZ</scope><scope>LK8</scope><scope>M2P</scope><scope>M7P</scope><scope>P64</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PSYQQ</scope><scope>Q9U</scope><scope>7X8</scope><scope>5PM</scope><scope>DOA</scope></search><sort><creationdate>20170808</creationdate><title>Networks of VTA Neurons Encode Real-Time Information about Uncertain Numbers of Actions Executed to Earn a Reward</title><author>Wood, Jesse ; Simon, Nicholas W ; Koerner, F Spencer ; Kass, Robert E ; Moghaddam, Bita</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c490t-b4048f5bbdea2a97dd601a5aad0f647b976044866fca5a541586257f359d1cec3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2017</creationdate><topic>assemblies</topic><topic>Basal ganglia</topic><topic>Behavior</topic><topic>Cognitive ability</topic><topic>Dopamine</topic><topic>ensemble coding</topic><topic>Food</topic><topic>Information processing</topic><topic>Laboratory animals</topic><topic>Mesencephalon</topic><topic>Neural coding</topic><topic>Neural networks</topic><topic>Neurons</topic><topic>Neuroscience</topic><topic>Prefrontal cortex</topic><topic>Reinforcement</topic><topic>Science</topic><topic>serial actions</topic><topic>ventral tegmental area</topic><topic>Ventral tegmentum</topic><topic>VTA</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Wood, Jesse</creatorcontrib><creatorcontrib>Simon, Nicholas W</creatorcontrib><creatorcontrib>Koerner, F Spencer</creatorcontrib><creatorcontrib>Kass, Robert E</creatorcontrib><creatorcontrib>Moghaddam, Bita</creatorcontrib><collection>PubMed</collection><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Animal Behavior Abstracts</collection><collection>Calcium &amp; Calcified Tissue Abstracts</collection><collection>Chemoreception Abstracts</collection><collection>Neurosciences Abstracts</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Science Database (Alumni Edition)</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Natural Science Collection</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>ProQuest Central Essentials</collection><collection>Biological Science Collection</collection><collection>AUTh Library subscriptions: ProQuest Central</collection><collection>ProQuest Natural Science Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>Engineering Research Database</collection><collection>ProQuest Central Student</collection><collection>SciTech Premium Collection (Proquest) (PQ_SDU_P3)</collection><collection>ProQuest Biological Science Collection</collection><collection>ProQuest Science Journals</collection><collection>ProQuest Biological Science Journals</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>ProQuest One Psychology</collection><collection>ProQuest Central Basic</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><collection>Directory of Open Access Journals</collection><jtitle>Frontiers in behavioral neuroscience</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Wood, Jesse</au><au>Simon, Nicholas W</au><au>Koerner, F Spencer</au><au>Kass, Robert E</au><au>Moghaddam, Bita</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Networks of VTA Neurons Encode Real-Time Information about Uncertain Numbers of Actions Executed to Earn a Reward</atitle><jtitle>Frontiers in behavioral neuroscience</jtitle><addtitle>Front Behav Neurosci</addtitle><date>2017-08-08</date><risdate>2017</risdate><volume>11</volume><spage>140</spage><epage>140</epage><pages>140-140</pages><issn>1662-5153</issn><eissn>1662-5153</eissn><abstract>Multiple and unpredictable numbers of actions are often required to achieve a goal. In order to organize behavior and allocate effort so that optimal behavioral policies can be selected, it is necessary to continually monitor ongoing actions. Real-time processing of information related to actions and outcomes is typically assigned to the prefrontal cortex and basal ganglia, but also depends on midbrain regions, especially the ventral tegmental area (VTA). We were interested in how individual VTA neurons, as well as networks within the VTA, encode salient events when an unpredictable number of serial actions are required to obtain a reward. We recorded from ensembles of putative dopamine and non-dopamine neurons in the VTA as animals performed multiple cued trials in a recording session where, in each trial, serial actions were randomly rewarded. While averaging population activity did not reveal a response pattern, we observed that different neurons were selectively tuned to low, medium, or high numbered actions in a trial. This preferential tuning of putative dopamine and non-dopamine VTA neurons to different subsets of actions in a trial allowed information about binned action number to be decoded from the ensemble activity. At the network level, tuning curve similarity was positively associated with action-evoked noise correlations, suggesting that action number selectivity reflects functional connectivity within these networks. Analysis of phasic responses to cue and reward revealed that the requirement to execute multiple and uncertain numbers of actions weakens both cue-evoked responses and cue-reward response correlation. The functional connectivity and ensemble coding scheme that we observe here may allow VTA neurons to cooperatively provide a real-time account of ongoing behavior. These computations may be critical to cognitive and motivational functions that have long been associated with VTA dopamine neurons.</abstract><cop>Switzerland</cop><pub>Frontiers Research Foundation</pub><pmid>28848408</pmid><doi>10.3389/fnbeh.2017.00140</doi><tpages>1</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1662-5153
ispartof Frontiers in behavioral neuroscience, 2017-08, Vol.11, p.140-140
issn 1662-5153
1662-5153
language eng
recordid cdi_doaj_primary_oai_doaj_org_article_298f437e4c6f4a13854fd11d130cdb88
source Open Access: PubMed Central; Publicly Available Content Database
subjects assemblies
Basal ganglia
Behavior
Cognitive ability
Dopamine
ensemble coding
Food
Information processing
Laboratory animals
Mesencephalon
Neural coding
Neural networks
Neurons
Neuroscience
Prefrontal cortex
Reinforcement
Science
serial actions
ventral tegmental area
Ventral tegmentum
VTA
title Networks of VTA Neurons Encode Real-Time Information about Uncertain Numbers of Actions Executed to Earn a Reward
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-25T23%3A04%3A28IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_doaj_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Networks%20of%20VTA%20Neurons%20Encode%20Real-Time%20Information%20about%20Uncertain%20Numbers%20of%20Actions%20Executed%20to%20Earn%20a%20Reward&rft.jtitle=Frontiers%20in%20behavioral%20neuroscience&rft.au=Wood,%20Jesse&rft.date=2017-08-08&rft.volume=11&rft.spage=140&rft.epage=140&rft.pages=140-140&rft.issn=1662-5153&rft.eissn=1662-5153&rft_id=info:doi/10.3389/fnbeh.2017.00140&rft_dat=%3Cproquest_doaj_%3E1933604627%3C/proquest_doaj_%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c490t-b4048f5bbdea2a97dd601a5aad0f647b976044866fca5a541586257f359d1cec3%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2299483484&rft_id=info:pmid/28848408&rfr_iscdi=true