An improved parametric-margin universum TSVM

• Published in: Neural computing & applications 2022-08, Vol.34 (16), p.13987-14001
• Main Authors: Li, Yanmeng, Sun, Huaijiang
• Format: Article
• Language: English
• Subjects: Artificial Intelligence; Classification; Computational Biology/Bioinformatics; Computational Science and Engineering; Computer Science; Data Mining and Knowledge Discovery; Hyperplanes; Image Processing and Computer Vision; Learning; Original Article; Probability and Statistics in Computer Science; Support vector machines
• ISSN: 0941-0643; 1433-3058
• DOI: 10.1007/s00521-022-07238-w

Motivated by the merit of twin support vector machine (TSVM), this paper presents an improved parametric-margin Universum twin support vector machine (PM-U-TSVM), which utilizes the prior knowledge contained in the Universum samples to improve the classification performance and exploits the parametric-margin strategy to be suitable for error structure to enhance the representation ability of the TSVM. Specifically, in contrast to the classic SVM-type methods that need to solve a single large-scale QPP problem, the proposed PM-U-TSVM extends twin SVM learning model by determining a pair of smaller size non-parallel parameter margin hyperplanes to provide a more flexible parametric-margin structure for input data, and analyzes the prior information ensconced in Universum to fully exploit the latent useful knowledge to construct the final classifier. This joint learning strategy can eventually help our model perform better in terms of effectiveness and robustness. Furthermore, the kernel extension of the PM-U-TSVM is proposed to deal with the nonlinear case. Experimental results on several datasets show that the proposed PM-U-TSVM not only achieves higher classification accuracy but also has better generalization performance when dealing with noisy classification problems.