Time series analysis using normalized PG-RBF network with regression weights

• Published in: Neurocomputing (Amsterdam) 2002, Vol.42 (1), p.267-285
• Main Authors: Rojas, I., Pomares, H., Bernier, J.L., Ortega, J., Pino, B., Pelayo, F.J., Prieto, A.
• Format: Article
• Language: English
• Subjects: Network growing; Pruning strategy; RBF neural networks; Sequential learning; Time series prediction
• ISSN: 0925-2312; 1872-8286
• DOI: 10.1016/S0925-2312(01)00338-1

This paper proposes a framework for constructing and training a radial basis function (RBF) neural network. For this purpose, a sequential learning algorithm is presented to adapt the structure of the network, in which it is possible to create a new hidden unit and also to detect and remove inactive units. The structure of the Gaussian functions is modified using a pseudo-Gaussian function (PG) in which two scaling parameters σ are introduced, which eliminates the symmetry restriction and provides the neurons in the hidden layer with greater flexibility with respect to function approximation. Other important characteristics of the proposed neural system are that the activation of the hidden neurons is normalized which, as described in the bibliography, provides a better performance than nonnormalization and instead of using a single parameter for the output weights, these are functions of the input variables which leads to a significant reduction in the number of hidden units compared to the classical RBF network. Finally, we examine the result of applying the proposed algorithm to time series prediction.