用图注意力与对比学习提升稀疏异构图的聚类效果
GCL-GCN: Graphormer and Contrastive Learning Enhanced Attributed Graph Clustering Network
- 引入Graphormer模块融合中心性与空间关系,捕捉节点全局局部信息
- 设计对比学习机制,使初始特征更具区分性,提升聚类质量
- 在6个数据集上优于14种方法,尤其在Cora上提升超10%
属性图聚类在现代数据分析中具有重要意义。然而,由于图数据的复杂性和节点属性的异质性,利用图结构进行聚类仍具挑战。为此,我们提出一种新型深度图聚类模型GCL-GCN,专门解决现有模型在处理稀疏异构图时难以捕捉局部依赖和复杂结构的问题。GCL-GCN引入创新的Graphormer模块,结合中心性编码与空间关系,有效捕捉节点间的全局与局部信息,提升节点表示质量。此外,提出新颖的对比学习模块,在预训练阶段通过原始特征矩阵上的对比学习增强特征表示的区分性,确保后续图卷积与聚类任务拥有更可识别的初始表示。在六个数据集上的大量实验表明,GCL-GCN在聚类质量和鲁棒性方面优于14种先进方法。具体而言,在Cora数据集上,其ACC、NMI和ARI分别比主要对比方法MBN提高4.94%、13.01%和10.97%。
原文摘要 · Abstract (English)
Attributed graph clustering holds significant importance in modern data analysis. However, due to the complexity of graph data and the heterogeneity of node attributes, leveraging graph information for clustering remains challenging. To address this, we propose a novel deep graph clustering model, GCL-GCN, specifically designed to address the limitations of existing models in capturing local dependencies and complex structures when dealing with sparse and heterogeneous graph data. GCL-GCN introduces an innovative Graphormer module that combines centrality encoding and spatial relationships, effectively capturing both global and local information between nodes, thereby enhancing the quality of node representations. Additionally, we propose a novel contrastive learning module that significantly enhances the discriminative power of feature representations. In the pre-training phase, this module increases feature distinction through contrastive learning on the original feature matrix, ensuring more identifiable initial representations for subsequent graph convolution and clustering tasks. Extensive experimental results on six datasets demonstrate that GCL-GCN outperforms 14 advanced methods in terms of clustering quality and robustness. Specifically, on the Cora dataset, it improves ACC, NMI, and ARI by 4.94%, 13.01%, and 10.97%, respectively, compared to the primary comparison method MBN.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。