arXiv:2412.11080cs.LGcs.CV2024-12被引 7

深度谱聚类联合优化嵌入与聚类,提升高维数据聚类效果

Deep Spectral Clustering via Joint Spectral Embedding and Kmeans

  • 用深度网络和幂迭代学习谱嵌入,替代传统相似图构建
  • 通过贪心策略迭代优化最差聚类方向,提升聚类结构
  • 端到端联合训练,实现在7个数据集上的最优表现

谱聚类是一种流行的聚类方法,先将数据映射到谱嵌入空间,再用Kmeans寻找聚类。然而,这两个步骤分离导致无法联合优化以获得最优解。此外,在高维数据上构建样本相似图会遭遇维度灾难。为解决这两个问题,我们提出深度谱聚类(DSC),包含两个核心模块:谱嵌入模块和贪心Kmeans模块。前者利用深度神经网络和幂迭代高效地将原始样本嵌入谱空间;后者通过贪心优化策略,在学习到的谱嵌入上改进Kmeans的聚类结构,迭代揭示最差聚类方向并优化嵌入。DSC将两个模块无缝集成,实现端到端联合优化。在七个真实世界数据集上的实验表明,DSC达到了当前最优的聚类性能。

原文摘要 · Abstract (English)

Spectral clustering is a popular clustering method. It first maps data into the spectral embedding space and then uses Kmeans to find clusters. However, the two decoupled steps prohibit joint optimization for the optimal solution. In addition, it needs to construct the similarity graph for samples, which suffers from the curse of dimensionality when the data are high-dimensional. To address these two challenges, we introduce \textbf{D}eep \textbf{S}pectral \textbf{C}lustering (\textbf{DSC}), which consists of two main modules: the spectral embedding module and the greedy Kmeans module. The former module learns to efficiently embed raw samples into the spectral embedding space using deep neural networks and power iteration. The latter module improves the cluster structures of Kmeans on the learned spectral embeddings by a greedy optimization strategy, which iteratively reveals the direction of the worst cluster structures and optimizes embeddings in this direction. To jointly optimize spectral embeddings and clustering, we seamlessly integrate the two modules and optimize them in an end-to-end manner. Experimental results on seven real-world datasets demonstrate that DSC achieves state-of-the-art clustering performance.

谱聚类深度学习聚类优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。