Sparse Subspace Clustering with Linear Subspace-Neighborhood-Preserving Data Embedding

• Main Authors: Wu, Jwo-Yuh, Huang, Liang-Chi, Li, Wen-Hsuan, Chan, Hau-Hsiang, Liu, Chun-Hung, Gau, Rung-Hung
• Format: Conference Proceeding
• Language: English
• Subjects: Clustering algorithms; compressive sensing; Computer simulation; Data compression; Dimensionality reduction; embedding; Euclidean distance; Machine learning algorithms; minimization; Signal processing algorithms; sparse representation; Sparse subspace clustering
• ISSN: 2151-870X
• DOI: 10.1109/SAM48682.2020.9104396

Data dimensionality reduction via linear embedding is a typical approach to economizing the computational cost of machine learning systems. In the context of sparse subspace clustering (SSC), this paper proposes a two-step neighbor identification scheme using linear neighborhoodpreserving embedding. In the first step, a quadratically- constrained ℓ 1 -minimization algorithm is solved for acquiring the side subspace neighborhood information, whereby a linear neighborhood-preserving embedding is designed accordingly. In the second step, a LASSO sparse regression algorithm is conducted for neighbor identification using the dimensionality- reduced data. The proposed embedding design explicitly takes into account the subspace neighborhood structure of the given data set. Computer simulations using real human face data show that the proposed embedding not only outperforms other existing dimensionality-reduction schemes but also improves the global data clustering accuracy when compared to the baseline solution without data compression.