Learning temporal sequences using dual-weight neurons

This paper considers the use of neural networks (NN's) in learning temporal sequence recognition and reproduction for which the sequence degree is unknown. This approach uses the output ambiguity to train the network without the need to assume or construct a separate model for the input sequenc...

Full description

Saved in:
Bibliographic Details
Published in:Journal of the Chinese Institute of Engineers 2001-04, Vol.24 (3), p.329-344
Main Authors: Wang, Jung-Hua, Tsai, Ming-Chieh, Su, Wen-sheng
Format: Article
Language:English
Subjects:
neural networks
self-organizing
speech recognition
temporal sequences
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper considers the use of neural networks (NN's) in learning temporal sequence recognition and reproduction for which the sequence degree is unknown. This approach uses the output ambiguity to train the network without the need to assume or construct a separate model for the input sequence degree. First we introduce a primitive network called the DNN, comprising a plurality of dual-weight (DN) neurons. Each neuron is linked to other neurons by a long-term excitatory weight and a short-term inhibitory weight. Fast learning is made possible by employing a two-pass training rule to encode the temporal distance between two arbitrary pattern occurrences. The resulting DNN is then extended into a more generalized model, namely the DNN2. By incorporating the two-pass rule and a self-organizing algorithm, the DNN2 can achieve autonomous temporal sequence recognition and reproduction. Using training efficiency and hardware complexity criteria, the DNN networks are also contrasted with the work of Wang and Yuwono (1995).
ISSN:0253-3839
2158-7299
DOI:10.1080/02533839.2001.9670631