Improving the Classification Performance of Dendrite Morphological Neurons

• Published in: IEEE transaction on neural networks and learning systems 2023-08, Vol.34 (8), p.4659-4673
• Main Authors: Gomez-Flores, Wilfrido, Sossa, Humberto
• Format: Article
• Language: English
• Subjects: Accuracy; Algorithms; Brain modeling; Classification; Coarseness; Complexity; Configuration management; Covariance matrices; Decision trees; Dendrite morphological neurons (DMNs); Dendrites; Dendrites (neurons); Geometric accuracy; geometric shape; Geometry; Mathematical models; Model accuracy; Morphology; Multilayer perceptrons; Neurons; Pattern classification; Performance assessment; Radial basis function; Shape; smooth activation functions; softmax layer; Support vector machines; Training; World problems
• ISSN: 2162-237X; 2162-2388
• DOI: 10.1109/TNNLS.2021.3116519

Dendrite morphological neurons (DMNs) are neural models for pattern classification, where dendrites are represented by a geometric shape enclosing patterns of the same class. This study evaluates the impact of three dendrite geometries-namely, box, ellipse, and sphere-on pattern classification. In addition, we propose using smooth maximum and minimum functions to reduce the coarseness of decision boundaries generated by typical DMNs, and a softmax layer is attached at the DMN output to provide posterior probabilities from weighted dendrites responses. To adjust the number of dendrites per class automatically, a tuning algorithm based on an incremental-decremental procedure is introduced. The classification performance assessment is conducted on nine synthetic and 49 real-world datasets. Meanwhile, 12 DMN variants are evaluated in terms of accuracy and model complexity. The DMN reaches its highest potential by combining spherical dendrites with smooth activation functions and a learnable softmax layer. It attained the highest accuracy, uses the simplest geometric shape, is insensitive to variables with zero variance, and its structural complexity diminishes by using the smooth maximum function. Furthermore, this DMN configuration performed competitively or even better than other well-established classifiers in terms of accuracy, such as support vector machine, multilayer perceptron, radial basis function network, k -nearest neighbors, and random forest. Thus, the proposed DMN is an attractive alternative for pattern classification in real-world problems.