A clustering algorithm for radial basis function neural network initialization

• Published in: Neurocomputing (Amsterdam) 2012-02, Vol.77 (1), p.144-155
• Main Authors: Wang, Di, Zeng, Xiao-Jun, Keane, John A.
• Format: Article
• Language: English
• Subjects: Algorithms; Approximation; Clustering; Clusters; Fuzzy C-Mean clustering; Mathematical analysis; Neural network; Neural networks; Partitions; Radial basis function; Radial basis function neural network
• ISSN: 0925-2312; 1872-8286
• DOI: 10.1016/j.neucom.2011.08.023

In this paper, we propose an Output-Constricted Clustering (OCC) algorithm for Radial Basis Function Neural Network (RBFNN) initialization. OCC first roughly partitions the output based on the required precision and then refinedly clusters data based on the input complexity within each output partition. The main contribution of the proposed clustering algorithm is that we introduce the concept of separability, which is a criterion to judge the suitability of the number of sub-clusters in each output partition. As a result, OCC is able to determine the proper number of sub-clusters with appropriate locations within each output partition by considering both input and output information. The resulting clusters from OCC are used to initialize RBFNN, with proper number and initial locations of for hidden neurons. As a result, RBFNN starting it's learning from a good point, is able to achieve better approximation performance than existing clustering methods for RBFNN initialization. This better performance is illustrated by a number of examples.