通过多尺度加权聚类与对比学习,提升图数据聚类效果
Attributed Graph Clustering with Multi-Scale Weight-Based Pairwise Coarsening and Contrastive Learning
- 基于全局节点相似性分层压缩图结构,保留关键信息
- 在ACM数据集上NMI提升15.24%,小规模数据集也显著增益
- 适合需要高精度图聚类的科研与工业场景
本文提出多尺度加权成对粗化与对比学习(MPCCL)模型,用于属性图聚类。现有方法常受限于长程依赖、特征坍缩和信息丢失问题:传统方法依赖低阶属性难以捕捉高阶特征,对比学习过度强调局部结构导致特征多样性不足,而常规粗化方法虽降低图规模却损失细粒度结构。MPCCL采用创新的多尺度粗化策略,逐步压缩图结构,优先合并基于全局节点相似性的关键边以保留核心结构信息。同时引入一对多对比学习范式,融合节点嵌入、增强图视图与聚类中心,提升特征多样性,并缓解多尺度粗化中高频节点权重累积引发的特征遮蔽问题。通过在自监督框架中加入图重构损失与KL散度,确保跨尺度表示一致性。实验表明,MPCCL在聚类性能上显著提升,如在ACM数据集上NMI提高15.24%,在Cora、Citeseer和DBLP等小规模数据集上也取得明显增益。
原文摘要 · Abstract (English)
This study introduces the Multi-Scale Weight-Based Pairwise Coarsening and Contrastive Learning (MPCCL) model, a novel approach for attributed graph clustering that effectively bridges critical gaps in existing methods, including long-range dependency, feature collapse, and information loss. Traditional methods often struggle to capture high-order graph features due to their reliance on low-order attribute information, while contrastive learning techniques face limitations in feature diversity by overemphasizing local neighborhood structures. Similarly, conventional graph coarsening methods, though reducing graph scale, frequently lose fine-grained structural details. MPCCL addresses these challenges through an innovative multi-scale coarsening strategy, which progressively condenses the graph while prioritizing the merging of key edges based on global node similarity to preserve essential structural information. It further introduces a one-to-many contrastive learning paradigm, integrating node embeddings with augmented graph views and cluster centroids to enhance feature diversity, while mitigating feature masking issues caused by the accumulation of high-frequency node weights during multi-scale coarsening. By incorporating a graph reconstruction loss and KL divergence into its self-supervised learning framework, MPCCL ensures cross-scale consistency of node representations. Experimental evaluations reveal that MPCCL achieves a significant improvement in clustering performance, including a remarkable 15.24% increase in NMI on the ACM dataset and notable robust gains on smaller-scale datasets such as Citeseer, Cora and DBLP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。