无需预设聚类数,基于双曲空间的结构信息学习实现高效去偏图聚类。
ASIL: Augmented Structural Information Learning for Deep Graph Clustering in Hyperbolic Space
- 构建可微分的连续结构信息框架,结合双曲空间建模聚类树。
- 在Citeseer上平均提升12.42% NMI,线性复杂度下显著改善图导纳。
- 适合处理类别不平衡的图数据,尤其擅长发现少数簇。
图聚类是机器学习中的经典问题。近年来深度方法虽取得进展,但仍需预设聚类数K,且在类别不平衡图上表现不佳。本文通过结构信息理论研究无需预设K的深度图聚类。现有结构信息多为离散定义,忽略节点属性且计算复杂。为此,我们提出可微分的连续结构信息框架,设计双曲模型LSEnet,在洛伦兹空间中学习神经聚类树。理论上证明其能无K聚类并识别少数簇。进一步优化双曲表示以增强语义表达;发现结构熵约束树对比损失,解决对比学习复杂度高的问题。最终提出新型增强结构信息学习(ASIL)方法,统一双曲聚类树构建与对比学习,实现线性复杂度下的有效去偏聚类。实验表明,ASIL在Citeseer上平均优于20个强基线+12.42% NMI。
原文摘要 · Abstract (English)
Graph clustering is a longstanding topic in machine learning. Recently, deep methods have achieved results but still require predefined cluster numbers K and struggle with imbalanced graphs. We study deep graph clustering without K considering realistic imbalance through structural information theory. In the literature, structural information is rarely used in deep clustering, and its classic discrete definition neglects node attributes while exhibiting prohibitive complexity. In this paper, we establish a differentiable structural information framework, generalizing the discrete formalism to the continuous realm. We design a hyperbolic model (LSEnet) to learn the neural partitioning tree in the Lorentz model. Theoretically, we demonstrate its capability in clustering without K and identifying minority clusters. Second, we refine hyperbolic representations to enhance graph semantics. Since tree contrastive learning is non-trivial and costs quadratic complexity, we advance our theory by discovering that structural entropy bounds the tree contrastive loss. Finally, we approach graph clustering through a novel augmented structural information learning (ASIL), which offers an efficient objective to integrate hyperbolic partitioning tree construction and contrastive learning. With a provable improvement in graph conductance, ASIL achieves effective debiased graph clustering in linear complexity. Extensive experiments show ASIL outperforms 20 strong baselines by an average of +12.42% in NMI on the Citeseer dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。