Loading…

Simple Models for Reading Neuronal Population Codes

In many neural systems, sensory information is distributed throughout a population of neurons. We study simple neural network models for extracting this information. The inputs to the networks are the stochastic responses of a population of sensory neurons tuned to directional stimuli. The performan...

Full description

Saved in:
Bibliographic Details
Published in:Proceedings of the National Academy of Sciences - PNAS 1993-11, Vol.90 (22), p.10749-10753
Main Authors: Seung, H. S., Sompolinsky, H.
Format: Article
Language:English
Subjects:
Citations: Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c589t-195b1e75c5340341c53e8a6ff6c1ec675c7418a9a6205496958fcbfe0aef21823
cites
container_end_page 10753
container_issue 22
container_start_page 10749
container_title Proceedings of the National Academy of Sciences - PNAS
container_volume 90
creator Seung, H. S.
Sompolinsky, H.
description In many neural systems, sensory information is distributed throughout a population of neurons. We study simple neural network models for extracting this information. The inputs to the networks are the stochastic responses of a population of sensory neurons tuned to directional stimuli. The performance of each network model in psychophysical tasks is compared with that of the optimal maximum likelihood procedure. As a model of direction estimation in two dimensions, we consider a linear network that computes a population vector. Its performance depends on the width of the population tuning curves and is maximal for width, which increases with the level of background activity. Although for narrowly tuned neurons the performance of the population vector is significantly inferior to that of maximum likelihood estimation, the difference between the two is small when the tuning is broad. For direction discrimination, we consider two models: a perceptron with fully adaptive weights and a network made by adding an adaptive second layer to the population vector network. We calculate the error rates of these networks after exhaustive training to a particular direction. By testing on the full range of possible directions, the extent of transfer of training to novel stimuli can be calculated. It is found that for threshold linear networks the transfer of perceptual learning is nonmonotonic. Although performance deteriorates away from the training stimulus, it peaks again at an intermediate angle. This nonmonotonicity provides an important psychophysical test of these models.
doi_str_mv 10.1073/pnas.90.22.10749
format article
fullrecord <record><control><sourceid>jstor_pubme</sourceid><recordid>TN_cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_47855</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><jstor_id>2363305</jstor_id><sourcerecordid>2363305</sourcerecordid><originalsourceid>FETCH-LOGICAL-c589t-195b1e75c5340341c53e8a6ff6c1ec675c7418a9a6205496958fcbfe0aef21823</originalsourceid><addsrcrecordid>eNp9kUuLFDEUhYM4jO3o3oViISJuqr15J-BGGkeF8YGPdUink7GadKVMqgb996any8Zx4eoSzndyT3IQeoBhiUHSF0Nvy1LDkpD9melbaIFB41YwDbfRAoDIVjHC7qC7pWwBQHMFp-hUEaawEAtEv3S7Ifrmfdr4WJqQcvPZ203XXzYf_JRTb2PzKQ1TtGOX-mZVsXIPnQQbi78_zzP07fz119Xb9uLjm3erVxet40qPLdZ8jb3kjlMGlOE6vbIiBOGwd6IKkmFltRUEONOiRgtuHTxYHwhWhJ6hl4d7h2m98xvn-zHbaIbc7Wz-ZZLtzE2l776by3RlmFScV_uz2Z7Tj8mX0ey64nyMtvdpKkYKkFyAruCTf8BtmnJ9eTEEMFEEa1whOEAup1KyD8ccGMy-C7PvwmgwhJjrLqrl0d_5j4b586v-dNZtcTaGbHvXlSNGlaQSQ8Uez9h-wR_15qLn_ydMmGIc_c-xog8P6LaMKR9ZQgWlwOlvYbey3w</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>201282191</pqid></control><display><type>article</type><title>Simple Models for Reading Neuronal Population Codes</title><source>JSTOR Archival Journals and Primary Sources Collection【Remote access available】</source><source>PubMed Central</source><creator>Seung, H. S. ; Sompolinsky, H.</creator><creatorcontrib>Seung, H. S. ; Sompolinsky, H.</creatorcontrib><description>In many neural systems, sensory information is distributed throughout a population of neurons. We study simple neural network models for extracting this information. The inputs to the networks are the stochastic responses of a population of sensory neurons tuned to directional stimuli. The performance of each network model in psychophysical tasks is compared with that of the optimal maximum likelihood procedure. As a model of direction estimation in two dimensions, we consider a linear network that computes a population vector. Its performance depends on the width of the population tuning curves and is maximal for width, which increases with the level of background activity. Although for narrowly tuned neurons the performance of the population vector is significantly inferior to that of maximum likelihood estimation, the difference between the two is small when the tuning is broad. For direction discrimination, we consider two models: a perceptron with fully adaptive weights and a network made by adding an adaptive second layer to the population vector network. We calculate the error rates of these networks after exhaustive training to a particular direction. By testing on the full range of possible directions, the extent of transfer of training to novel stimuli can be calculated. It is found that for threshold linear networks the transfer of perceptual learning is nonmonotonic. Although performance deteriorates away from the training stimulus, it peaks again at an intermediate angle. This nonmonotonicity provides an important psychophysical test of these models.</description><identifier>ISSN: 0027-8424</identifier><identifier>EISSN: 1091-6490</identifier><identifier>DOI: 10.1073/pnas.90.22.10749</identifier><identifier>PMID: 8248166</identifier><identifier>CODEN: PNASA6</identifier><language>eng</language><publisher>Washington, DC: National Academy of Sciences of the United States of America</publisher><subject>Animals ; Biological and medical sciences ; Fundamental and applied biological sciences. Psychology ; Humans ; Likelihood Functions ; Mental stimulation ; Models, Theoretical ; Nerve Net ; Nervous system ; Neurons ; Neurons, Afferent - physiology ; Orientation - physiology ; Perception ; Perception - physiology ; Perceptual learning ; Population distributions ; Population estimates ; Psychology. Psychoanalysis. Psychiatry ; Psychology. Psychophysiology ; Psychophysics ; Self organizing systems ; Sensory discrimination ; Stochastic Processes ; Transfer of training ; Visual cortex</subject><ispartof>Proceedings of the National Academy of Sciences - PNAS, 1993-11, Vol.90 (22), p.10749-10753</ispartof><rights>Copyright 1993 National Academy of Sciences of the United States of America</rights><rights>1994 INIST-CNRS</rights><rights>Copyright National Academy of Sciences Nov 15, 1993</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c589t-195b1e75c5340341c53e8a6ff6c1ec675c7418a9a6205496958fcbfe0aef21823</citedby></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Uhttp://www.pnas.org/content/90/22.cover.gif</thumbnail><linktopdf>$$Uhttps://www.jstor.org/stable/pdf/2363305$$EPDF$$P50$$Gjstor$$H</linktopdf><linktohtml>$$Uhttps://www.jstor.org/stable/2363305$$EHTML$$P50$$Gjstor$$H</linktohtml><link.rule.ids>230,314,724,777,781,882,27905,27906,53772,53774,58219,58452</link.rule.ids><backlink>$$Uhttp://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&amp;idt=3873710$$DView record in Pascal Francis$$Hfree_for_read</backlink><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/8248166$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Seung, H. S.</creatorcontrib><creatorcontrib>Sompolinsky, H.</creatorcontrib><title>Simple Models for Reading Neuronal Population Codes</title><title>Proceedings of the National Academy of Sciences - PNAS</title><addtitle>Proc Natl Acad Sci U S A</addtitle><description>In many neural systems, sensory information is distributed throughout a population of neurons. We study simple neural network models for extracting this information. The inputs to the networks are the stochastic responses of a population of sensory neurons tuned to directional stimuli. The performance of each network model in psychophysical tasks is compared with that of the optimal maximum likelihood procedure. As a model of direction estimation in two dimensions, we consider a linear network that computes a population vector. Its performance depends on the width of the population tuning curves and is maximal for width, which increases with the level of background activity. Although for narrowly tuned neurons the performance of the population vector is significantly inferior to that of maximum likelihood estimation, the difference between the two is small when the tuning is broad. For direction discrimination, we consider two models: a perceptron with fully adaptive weights and a network made by adding an adaptive second layer to the population vector network. We calculate the error rates of these networks after exhaustive training to a particular direction. By testing on the full range of possible directions, the extent of transfer of training to novel stimuli can be calculated. It is found that for threshold linear networks the transfer of perceptual learning is nonmonotonic. Although performance deteriorates away from the training stimulus, it peaks again at an intermediate angle. This nonmonotonicity provides an important psychophysical test of these models.</description><subject>Animals</subject><subject>Biological and medical sciences</subject><subject>Fundamental and applied biological sciences. Psychology</subject><subject>Humans</subject><subject>Likelihood Functions</subject><subject>Mental stimulation</subject><subject>Models, Theoretical</subject><subject>Nerve Net</subject><subject>Nervous system</subject><subject>Neurons</subject><subject>Neurons, Afferent - physiology</subject><subject>Orientation - physiology</subject><subject>Perception</subject><subject>Perception - physiology</subject><subject>Perceptual learning</subject><subject>Population distributions</subject><subject>Population estimates</subject><subject>Psychology. Psychoanalysis. Psychiatry</subject><subject>Psychology. Psychophysiology</subject><subject>Psychophysics</subject><subject>Self organizing systems</subject><subject>Sensory discrimination</subject><subject>Stochastic Processes</subject><subject>Transfer of training</subject><subject>Visual cortex</subject><issn>0027-8424</issn><issn>1091-6490</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>1993</creationdate><recordtype>article</recordtype><recordid>eNp9kUuLFDEUhYM4jO3o3oViISJuqr15J-BGGkeF8YGPdUink7GadKVMqgb996any8Zx4eoSzndyT3IQeoBhiUHSF0Nvy1LDkpD9melbaIFB41YwDbfRAoDIVjHC7qC7pWwBQHMFp-hUEaawEAtEv3S7Ifrmfdr4WJqQcvPZ203XXzYf_JRTb2PzKQ1TtGOX-mZVsXIPnQQbi78_zzP07fz119Xb9uLjm3erVxet40qPLdZ8jb3kjlMGlOE6vbIiBOGwd6IKkmFltRUEONOiRgtuHTxYHwhWhJ6hl4d7h2m98xvn-zHbaIbc7Wz-ZZLtzE2l776by3RlmFScV_uz2Z7Tj8mX0ey64nyMtvdpKkYKkFyAruCTf8BtmnJ9eTEEMFEEa1whOEAup1KyD8ccGMy-C7PvwmgwhJjrLqrl0d_5j4b586v-dNZtcTaGbHvXlSNGlaQSQ8Uez9h-wR_15qLn_ydMmGIc_c-xog8P6LaMKR9ZQgWlwOlvYbey3w</recordid><startdate>19931115</startdate><enddate>19931115</enddate><creator>Seung, H. S.</creator><creator>Sompolinsky, H.</creator><general>National Academy of Sciences of the United States of America</general><general>National Acad Sciences</general><general>National Academy of Sciences</general><scope>IQODW</scope><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7QG</scope><scope>7QL</scope><scope>7QP</scope><scope>7QR</scope><scope>7SN</scope><scope>7SS</scope><scope>7T5</scope><scope>7TK</scope><scope>7TM</scope><scope>7TO</scope><scope>7U9</scope><scope>8FD</scope><scope>C1K</scope><scope>FR3</scope><scope>H94</scope><scope>M7N</scope><scope>P64</scope><scope>RC3</scope><scope>7X8</scope><scope>5PM</scope></search><sort><creationdate>19931115</creationdate><title>Simple Models for Reading Neuronal Population Codes</title><author>Seung, H. S. ; Sompolinsky, H.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c589t-195b1e75c5340341c53e8a6ff6c1ec675c7418a9a6205496958fcbfe0aef21823</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>1993</creationdate><topic>Animals</topic><topic>Biological and medical sciences</topic><topic>Fundamental and applied biological sciences. Psychology</topic><topic>Humans</topic><topic>Likelihood Functions</topic><topic>Mental stimulation</topic><topic>Models, Theoretical</topic><topic>Nerve Net</topic><topic>Nervous system</topic><topic>Neurons</topic><topic>Neurons, Afferent - physiology</topic><topic>Orientation - physiology</topic><topic>Perception</topic><topic>Perception - physiology</topic><topic>Perceptual learning</topic><topic>Population distributions</topic><topic>Population estimates</topic><topic>Psychology. Psychoanalysis. Psychiatry</topic><topic>Psychology. Psychophysiology</topic><topic>Psychophysics</topic><topic>Self organizing systems</topic><topic>Sensory discrimination</topic><topic>Stochastic Processes</topic><topic>Transfer of training</topic><topic>Visual cortex</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Seung, H. S.</creatorcontrib><creatorcontrib>Sompolinsky, H.</creatorcontrib><collection>Pascal-Francis</collection><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Animal Behavior Abstracts</collection><collection>Bacteriology Abstracts (Microbiology B)</collection><collection>Calcium &amp; Calcified Tissue Abstracts</collection><collection>Chemoreception Abstracts</collection><collection>Ecology Abstracts</collection><collection>Entomology Abstracts (Full archive)</collection><collection>Immunology Abstracts</collection><collection>Neurosciences Abstracts</collection><collection>Nucleic Acids Abstracts</collection><collection>Oncogenes and Growth Factors Abstracts</collection><collection>Virology and AIDS Abstracts</collection><collection>Technology Research Database</collection><collection>Environmental Sciences and Pollution Management</collection><collection>Engineering Research Database</collection><collection>AIDS and Cancer Research Abstracts</collection><collection>Algology Mycology and Protozoology Abstracts (Microbiology C)</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>Genetics Abstracts</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><jtitle>Proceedings of the National Academy of Sciences - PNAS</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Seung, H. S.</au><au>Sompolinsky, H.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Simple Models for Reading Neuronal Population Codes</atitle><jtitle>Proceedings of the National Academy of Sciences - PNAS</jtitle><addtitle>Proc Natl Acad Sci U S A</addtitle><date>1993-11-15</date><risdate>1993</risdate><volume>90</volume><issue>22</issue><spage>10749</spage><epage>10753</epage><pages>10749-10753</pages><issn>0027-8424</issn><eissn>1091-6490</eissn><coden>PNASA6</coden><abstract>In many neural systems, sensory information is distributed throughout a population of neurons. We study simple neural network models for extracting this information. The inputs to the networks are the stochastic responses of a population of sensory neurons tuned to directional stimuli. The performance of each network model in psychophysical tasks is compared with that of the optimal maximum likelihood procedure. As a model of direction estimation in two dimensions, we consider a linear network that computes a population vector. Its performance depends on the width of the population tuning curves and is maximal for width, which increases with the level of background activity. Although for narrowly tuned neurons the performance of the population vector is significantly inferior to that of maximum likelihood estimation, the difference between the two is small when the tuning is broad. For direction discrimination, we consider two models: a perceptron with fully adaptive weights and a network made by adding an adaptive second layer to the population vector network. We calculate the error rates of these networks after exhaustive training to a particular direction. By testing on the full range of possible directions, the extent of transfer of training to novel stimuli can be calculated. It is found that for threshold linear networks the transfer of perceptual learning is nonmonotonic. Although performance deteriorates away from the training stimulus, it peaks again at an intermediate angle. This nonmonotonicity provides an important psychophysical test of these models.</abstract><cop>Washington, DC</cop><pub>National Academy of Sciences of the United States of America</pub><pmid>8248166</pmid><doi>10.1073/pnas.90.22.10749</doi><tpages>5</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0027-8424
ispartof Proceedings of the National Academy of Sciences - PNAS, 1993-11, Vol.90 (22), p.10749-10753
issn 0027-8424
1091-6490
language eng
recordid cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_47855
source JSTOR Archival Journals and Primary Sources Collection【Remote access available】; PubMed Central
subjects Animals
Biological and medical sciences
Fundamental and applied biological sciences. Psychology
Humans
Likelihood Functions
Mental stimulation
Models, Theoretical
Nerve Net
Nervous system
Neurons
Neurons, Afferent - physiology
Orientation - physiology
Perception
Perception - physiology
Perceptual learning
Population distributions
Population estimates
Psychology. Psychoanalysis. Psychiatry
Psychology. Psychophysiology
Psychophysics
Self organizing systems
Sensory discrimination
Stochastic Processes
Transfer of training
Visual cortex
title Simple Models for Reading Neuronal Population Codes
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-20T14%3A44%3A29IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-jstor_pubme&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Simple%20Models%20for%20Reading%20Neuronal%20Population%20Codes&rft.jtitle=Proceedings%20of%20the%20National%20Academy%20of%20Sciences%20-%20PNAS&rft.au=Seung,%20H.%20S.&rft.date=1993-11-15&rft.volume=90&rft.issue=22&rft.spage=10749&rft.epage=10753&rft.pages=10749-10753&rft.issn=0027-8424&rft.eissn=1091-6490&rft.coden=PNASA6&rft_id=info:doi/10.1073/pnas.90.22.10749&rft_dat=%3Cjstor_pubme%3E2363305%3C/jstor_pubme%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c589t-195b1e75c5340341c53e8a6ff6c1ec675c7418a9a6205496958fcbfe0aef21823%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=201282191&rft_id=info:pmid/8248166&rft_jstor_id=2363305&rfr_iscdi=true