Loading…

Reservoir computing and the Sooner-is-Better bottleneck

Prior language input is not lost but integrated with the current input. This principle is demonstrated by "reservoir computing": Untrained recurrent neural networks project input sequences onto a random point in high-dimensional state space. Earlier inputs can be retrieved from this projec...

Full description

Saved in:
Bibliographic Details
Published in:The Behavioral and brain sciences 2016-01, Vol.39, p.e73-e73, Article e73
Main Authors: Frank, Stefan L, Fitz, Hartmut
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Prior language input is not lost but integrated with the current input. This principle is demonstrated by "reservoir computing": Untrained recurrent neural networks project input sequences onto a random point in high-dimensional state space. Earlier inputs can be retrieved from this projection, albeit less reliably so as more input is received. The bottleneck is therefore not "Now-or-Never" but "Sooner-is-Better."
ISSN:0140-525X
1469-1825
DOI:10.1017/S0140525X15000783