用深度结构熵增强图结构,提升稀疏或噪声图的聚类效果
Unsupervised Graph Clustering with Deep Structural Entropy
- 通过软分配计算可微的结构熵,量化图的内在结构信息
- 设计结构学习层,生成带属性的图以优化原始稀疏连接
- 基于GNN的软分配聚类方法,降低结构熵并保持节点一致性
图结构学习研究为基于图的聚类提供了关键见解,但现有方法如图神经网络(GNN)、图注意力网络(GAT)和对比学习高度依赖原始图结构。当邻接矩阵过于稀疏或包含与聚类无关的噪声边时,性能显著下降。此外,这些方法依赖学习节点嵌入并使用k-means等传统技术形成聚类,难以充分捕捉节点间的潜在结构。为此,本文提出DeSE——一种融合深度结构熵的无监督图聚类框架。首先,提出基于软分配的结构熵计算方法,以可微形式量化结构;其次,设计结构学习层(SLL),从原始特征数据生成属性图作为目标,用于增强和优化原始结构图,缓解节点间连接稀疏问题;最后,提出基于GNN的聚类分配层(ASS),学习节点嵌入与软分配矩阵,在增强图上完成聚类,可通过堆叠满足下游任务需求,最小化结构熵以实现稳定聚类,并通过基于边的交叉熵损失最大化节点一致性。在四个基准数据集上对八种代表性无监督图聚类基线进行大量对比实验,验证了DeSE在有效性与可解释性上的优越性。
原文摘要 · Abstract (English)
Research on Graph Structure Learning (GSL) provides key insights for graph-based clustering, yet current methods like Graph Neural Networks (GNNs), Graph Attention Networks (GATs), and contrastive learning often rely heavily on the original graph structure. Their performance deteriorates when the original graph's adjacency matrix is too sparse or contains noisy edges unrelated to clustering. Moreover, these methods depend on learning node embeddings and using traditional techniques like k-means to form clusters, which may not fully capture the underlying graph structure between nodes. To address these limitations, this paper introduces DeSE, a novel unsupervised graph clustering framework incorporating Deep Structural Entropy. It enhances the original graph with quantified structural information and deep neural networks to form clusters. Specifically, we first propose a method for calculating structural entropy with soft assignment, which quantifies structure in a differentiable form. Next, we design a Structural Learning layer (SLL) to generate an attributed graph from the original feature data, serving as a target to enhance and optimize the original structural graph, thereby mitigating the issue of sparse connections between graph nodes. Finally, our clustering assignment method (ASS), based on GNNs, learns node embeddings and a soft assignment matrix to cluster on the enhanced graph. The ASS layer can be stacked to meet downstream task requirements, minimizing structural entropy for stable clustering and maximizing node consistency with edge-based cross-entropy loss. Extensive comparative experiments are conducted on four benchmark datasets against eight representative unsupervised graph clustering baselines, demonstrating the superiority of the DeSE in both effectiveness and interpretability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。