Dynamic training rate for backpropagation learning algorithm

In this paper, we created a dynamic function training rate for the Back propagation learning algorithm to avoid the local minimum and to speed up training. The Back propagation with dynamic training rate (BPDR) algorithm uses the sigmoid function. The 2-dimensional XOR problem and iris data were use...

Full description

Saved in:
Bibliographic Details
Main Authors: Al-Duais, M. S., Yaakub, A. R., Yusoff, N.
Format: Conference Proceeding
Language:English
Subjects:
adaptive training
Artificial neural networks
Back propagation algorithm
Conferences
dynamic training rate
Equations
Heuristic algorithms
Iris
Neurons
Testing
Training
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this paper, we created a dynamic function training rate for the Back propagation learning algorithm to avoid the local minimum and to speed up training. The Back propagation with dynamic training rate (BPDR) algorithm uses the sigmoid function. The 2-dimensional XOR problem and iris data were used as benchmarks to test the effects of the dynamic training rate formulated in this paper. The results of these experiments demonstrate that the BPDR algorithm is advantageous with regards to both generalization performance and training speed. The stop training or limited error was determined by 1.0 e-5 .
DOI:10.1109/MICC.2013.6805839