Developing a feature weight self-adjustment mechanism for a K-means clustering algorithm

• Published in: Computational statistics & data analysis 2008-06, Vol.52 (10), p.4658-4672
• Main Authors: Tsai, Chieh-Yuan, Chiu, Chuang-Cheng
• Format: Article
• Language: English
• Subjects: Calculus of variations and optimal control; Exact sciences and technology; General topics; Mathematical analysis; Mathematics; Multivariate analysis; Numerical analysis; Numerical analysis. Scientific computation; Numerical methods in probability and statistics; Probability and statistics; Sciences and techniques of general use; Statistics
• ISSN: 0167-9473; 1872-7352
• DOI: 10.1016/j.csda.2008.03.002

K-means is one of the most popular and widespread partitioning clustering algorithms due to its superior scalability and efficiency. Typically, the K-means algorithm treats all features fairly and sets weights of all features equally when evaluating dissimilarity. However, a meaningful clustering phenomenon often occurs in a subspace defined by a specific subset of all features. To address this issue, this paper proposes a novel feature weight self-adjustment (FWSA) mechanism embedded into K-means in order to improve the clustering quality of K-means. In the FWSA mechanism, finding feature weights is modeled as an optimization problem to simultaneously minimize the separations within clusters and maximize the separations between clusters. With this objective, the adjustment margin of a feature weight can be derived based on the importance of the feature to the clustering quality. At each iteration in K-means, all feature weights are adaptively updated by adding their respective adjustment margins. A number of synthetic and real data are experimented on to show the benefits of the proposed FWAS mechanism. In addition, when compared to a recent similar feature weighting work, the proposed mechanism illustrates several advantages in both the theoretical and experimental results.