arXiv:2503.06635cs.LGcs.AI2025-03被引 11

提出新框架DCGC,用图割思想解决深度聚类的表示坍塌问题。

Deep Cut-informed Graph Embedding and Clustering

  • 从图割角度设计编码目标,融合结构与属性信息
  • 利用最优传输实现聚类分配,避免全部节点聚集单一标签
  • 不依赖GNN,适合高阶图聚类任务,性能优于基准方法

图聚类旨在将图划分为不同簇。当前基于图神经网络(GNN)的深度图聚类方法普遍存在表示坍塌问题。我们分析其主因:(i) GNN的归纳偏置导致邻近节点表示趋同,而图中存在显著的跨簇边,引发错误消息传递;(ii) 聚类引导损失函数迫使所有样本靠近预学习的中心,导致退化解——所有点被分配同一标签,失去判别性。为此,我们从图割视角出发,提出非GNN架构的Deep Cut-informed Graph Embedding and Clustering(DCGC)框架。该框架包含两模块:(i) 割感知图编码,通过最小化联合归一化割来融合结构与属性信息;(ii) 基于最优传输的自监督聚类,平衡“靠近簇中心”的引导作用。两个模块协同设计,有效缓解表示坍塌,提升聚类性能。大量实验表明,相比基准方法,该方法简单且高效。

原文摘要 · Abstract (English)

Graph clustering aims to divide the graph into different clusters. The recently emerging deep graph clustering approaches are largely built on graph neural networks (GNN). However, GNN is designed for general graph encoding and there is a common issue of representation collapse in existing GNN-based deep graph clustering algorithms. We attribute two main reasons for such issues: (i) the inductive bias of GNN models: GNNs tend to generate similar representations for proximal nodes. Since graphs often contain a non-negligible amount of inter-cluster links, the bias results in error message passing and leads to biased clustering; (ii) the clustering guided loss function: most traditional approaches strive to make all samples closer to pre-learned cluster centers, which causes a degenerate solution assigning all data points to a single label thus making all samples similar and less discriminative. To address these challenges, we investigate graph clustering from a graph cut perspective and propose an innovative and non-GNN-based Deep Cut-informed Graph embedding and Clustering framework, namely DCGC. This framework includes two modules: (i) cut-informed graph encoding; (ii) self-supervised graph clustering via optimal transport. For the encoding module, we derive a cut-informed graph embedding objective to fuse graph structure and attributes by minimizing their joint normalized cut. For the clustering module, we utilize the optimal transport theory to obtain the clustering assignments, which can balance the guidance of "proximity to the pre-learned cluster center". With the above two tailored designs, DCGC is more suitable for the graph clustering task, which can effectively alleviate the problem of representation collapse and achieve better performance. We conduct extensive experiments to demonstrate that our method is simple but effective compared with benchmarks.

图聚类图割最优传输表示坍塌

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。