不依赖中心点的图嵌入聚类,自动保持类别平衡
Self-Supervised Graph Embedding Clustering
- 将K-means与流形学习统一,无需显式定义聚类中心
- 通过ℓ₂,₁-范数最大化实现自动类别平衡,理论可证
- 一阶段完成聚类,避免冗余超参数,适合高维数据
K-means一步降维聚类方法在缓解聚类任务中的维度灾难方面取得一定进展。然而,该方法将K-means聚类与降维过程联合优化,因引入超参数及聚类中心初始化,导致聚类效果受限,且聚类过程中维持类别平衡仍具挑战。为克服上述问题,我们提出一种融合流形学习与K-means的统一框架——自监督图嵌入框架。具体而言,建立K-means与流形结构之间的联系,使我们可在无需显式定义中心点的情况下执行K-means。此外,利用此无中心点的K-means在低维空间生成标签,并进一步基于标签信息确定样本间相似性,从而确保流形结构与标签的一致性。该方法有效实现一步聚类,无需冗余的平衡超参数。值得注意的是,我们发现最大化ℓ₂,₁-范数天然可维持聚类过程中的类别平衡,这一结论已获理论证明。最后,在多个数据集上的实验表明,Our-LPP与Our-MFA的聚类结果展现出优异且可靠的表现。
原文摘要 · Abstract (English)
The K-means one-step dimensionality reduction clustering method has made some progress in addressing the curse of dimensionality in clustering tasks. However, it combines the K-means clustering and dimensionality reduction processes for optimization, leading to limitations in the clustering effect due to the introduced hyperparameters and the initialization of clustering centers. Moreover, maintaining class balance during clustering remains challenging. To overcome these issues, we propose a unified framework that integrates manifold learning with K-means, resulting in the self-supervised graph embedding framework. Specifically, we establish a connection between K-means and the manifold structure, allowing us to perform K-means without explicitly defining centroids. Additionally, we use this centroid-free K-means to generate labels in low-dimensional space and subsequently utilize the label information to determine the similarity between samples. This approach ensures consistency between the manifold structure and the labels. Our model effectively achieves one-step clustering without the need for redundant balancing hyperparameters. Notably, we have discovered that maximizing the $\ell_{2,1}$-norm naturally maintains class balance during clustering, a result that we have theoretically proven. Finally, experiments on multiple datasets demonstrate that the clustering results of Our-LPP and Our-MFA exhibit excellent and reliable performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。