Efficient representation as a design principle for neural coding and computation

Does the brain construct an efficient representation of the sensory world? We review progress on this question, focusing on a series of experiments in the last decade which use fly vision as a model system in which theory and experiment can confront each other. Although the idea of efficient represe...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2007-12
Main Authors: Bialek, William, Rob R de Ruyter van Steveninck, Tishby, Naftali
Format: Article
Language:English
Subjects:
Brain
Information theory
Optimization
Representations
Visual flight
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites
container_end_page
container_issue
container_start_page
container_title arXiv.org
container_volume
creator Bialek, William
Rob R de Ruyter van Steveninck
Tishby, Naftali
description Does the brain construct an efficient representation of the sensory world? We review progress on this question, focusing on a series of experiments in the last decade which use fly vision as a model system in which theory and experiment can confront each other. Although the idea of efficient representation has been productive, clearly it is incomplete since it doesn't tell us which bits of sensory information are most valuable to the organism. We suggest that an organism which maximizes the (biologically meaningful) adaptive value of its actions given fixed resources should have internal representations of the outside world that are optimal in a very specific information theoretic sense: they maximize the information about the future of sensory inputs at a fixed value of the information about their past. This principle contains as special cases computations which the brain seems to carry out, and it should be possible to test this optimization directly. We return to the fly visual system and report the results of preliminary experiments that are in encouraging agreement with theory.
format article
fullrecord <record><control><sourceid>proquest</sourceid><recordid>TN_cdi_proquest_journals_2092246359</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2092246359</sourcerecordid><originalsourceid>FETCH-proquest_journals_20922463593</originalsourceid><addsrcrecordid>eNqNi0EKwjAQRYMgWLR3GHBdiJO22rVUXLpwX0I7KSl1EpPm_hb0AK7eg_f_RmSo1Km4lIg7kcc4SSmxPmNVqUw8WmNsb4kXCOQDxdX0Yh2DjqBhoGhHBh8s99bPBMYFYEpBz9C7wfIImodVXz59fwexNXqOlP-4F8db-7zeCx_cO1FcusmlwGvqUDaIZa2qRv23-gCp3z-G</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2092246359</pqid></control><display><type>article</type><title>Efficient representation as a design principle for neural coding and computation</title><source>Publicly Available Content Database</source><creator>Bialek, William ; Rob R de Ruyter van Steveninck ; Tishby, Naftali</creator><creatorcontrib>Bialek, William ; Rob R de Ruyter van Steveninck ; Tishby, Naftali</creatorcontrib><description>Does the brain construct an efficient representation of the sensory world? We review progress on this question, focusing on a series of experiments in the last decade which use fly vision as a model system in which theory and experiment can confront each other. Although the idea of efficient representation has been productive, clearly it is incomplete since it doesn't tell us which bits of sensory information are most valuable to the organism. We suggest that an organism which maximizes the (biologically meaningful) adaptive value of its actions given fixed resources should have internal representations of the outside world that are optimal in a very specific information theoretic sense: they maximize the information about the future of sensory inputs at a fixed value of the information about their past. This principle contains as special cases computations which the brain seems to carry out, and it should be possible to test this optimization directly. We return to the fly visual system and report the results of preliminary experiments that are in encouraging agreement with theory.</description><identifier>EISSN: 2331-8422</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Brain ; Information theory ; Optimization ; Representations ; Visual flight</subject><ispartof>arXiv.org, 2007-12</ispartof><rights>Notwithstanding the ProQuest Terms and conditions, you may use this content in accordance with the associated terms available at http://arxiv.org/abs/0712.4381.</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.proquest.com/docview/2092246359?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>776,780,25731,36989,44566</link.rule.ids></links><search><creatorcontrib>Bialek, William</creatorcontrib><creatorcontrib>Rob R de Ruyter van Steveninck</creatorcontrib><creatorcontrib>Tishby, Naftali</creatorcontrib><title>Efficient representation as a design principle for neural coding and computation</title><title>arXiv.org</title><description>Does the brain construct an efficient representation of the sensory world? We review progress on this question, focusing on a series of experiments in the last decade which use fly vision as a model system in which theory and experiment can confront each other. Although the idea of efficient representation has been productive, clearly it is incomplete since it doesn't tell us which bits of sensory information are most valuable to the organism. We suggest that an organism which maximizes the (biologically meaningful) adaptive value of its actions given fixed resources should have internal representations of the outside world that are optimal in a very specific information theoretic sense: they maximize the information about the future of sensory inputs at a fixed value of the information about their past. This principle contains as special cases computations which the brain seems to carry out, and it should be possible to test this optimization directly. We return to the fly visual system and report the results of preliminary experiments that are in encouraging agreement with theory.</description><subject>Brain</subject><subject>Information theory</subject><subject>Optimization</subject><subject>Representations</subject><subject>Visual flight</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2007</creationdate><recordtype>article</recordtype><sourceid>PIMPY</sourceid><recordid>eNqNi0EKwjAQRYMgWLR3GHBdiJO22rVUXLpwX0I7KSl1EpPm_hb0AK7eg_f_RmSo1Km4lIg7kcc4SSmxPmNVqUw8WmNsb4kXCOQDxdX0Yh2DjqBhoGhHBh8s99bPBMYFYEpBz9C7wfIImodVXz59fwexNXqOlP-4F8db-7zeCx_cO1FcusmlwGvqUDaIZa2qRv23-gCp3z-G</recordid><startdate>20071228</startdate><enddate>20071228</enddate><creator>Bialek, William</creator><creator>Rob R de Ruyter van Steveninck</creator><creator>Tishby, Naftali</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope></search><sort><creationdate>20071228</creationdate><title>Efficient representation as a design principle for neural coding and computation</title><author>Bialek, William ; Rob R de Ruyter van Steveninck ; Tishby, Naftali</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-proquest_journals_20922463593</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2007</creationdate><topic>Brain</topic><topic>Information theory</topic><topic>Optimization</topic><topic>Representations</topic><topic>Visual flight</topic><toplevel>online_resources</toplevel><creatorcontrib>Bialek, William</creatorcontrib><creatorcontrib>Rob R de Ruyter van Steveninck</creatorcontrib><creatorcontrib>Tishby, Naftali</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science &amp; Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Bialek, William</au><au>Rob R de Ruyter van Steveninck</au><au>Tishby, Naftali</au><format>book</format><genre>document</genre><ristype>GEN</ristype><atitle>Efficient representation as a design principle for neural coding and computation</atitle><jtitle>arXiv.org</jtitle><date>2007-12-28</date><risdate>2007</risdate><eissn>2331-8422</eissn><abstract>Does the brain construct an efficient representation of the sensory world? We review progress on this question, focusing on a series of experiments in the last decade which use fly vision as a model system in which theory and experiment can confront each other. Although the idea of efficient representation has been productive, clearly it is incomplete since it doesn't tell us which bits of sensory information are most valuable to the organism. We suggest that an organism which maximizes the (biologically meaningful) adaptive value of its actions given fixed resources should have internal representations of the outside world that are optimal in a very specific information theoretic sense: they maximize the information about the future of sensory inputs at a fixed value of the information about their past. This principle contains as special cases computations which the brain seems to carry out, and it should be possible to test this optimization directly. We return to the fly visual system and report the results of preliminary experiments that are in encouraging agreement with theory.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier EISSN: 2331-8422
ispartof arXiv.org, 2007-12
issn 2331-8422
language eng
recordid cdi_proquest_journals_2092246359
source Publicly Available Content Database
subjects Brain
Information theory
Optimization
Representations
Visual flight
title Efficient representation as a design principle for neural coding and computation
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-07T07%3A35%3A10IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=document&rft.atitle=Efficient%20representation%20as%20a%20design%20principle%20for%20neural%20coding%20and%20computation&rft.jtitle=arXiv.org&rft.au=Bialek,%20William&rft.date=2007-12-28&rft.eissn=2331-8422&rft_id=info:doi/&rft_dat=%3Cproquest%3E2092246359%3C/proquest%3E%3Cgrp_id%3Ecdi_FETCH-proquest_journals_20922463593%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2092246359&rft_id=info:pmid/&rfr_iscdi=true