arXiv:2506.06682cs.LG2025-06

提出HetCRF框架,提升异构图在稀疏语义下的自监督学习效果。

Learning Robust Heterogeneous Graph Representations via Contrastive-Reconstruction under Sparse Semantics

  • 双通道设计分离重建与对比学习,适应异构图特征
  • 在40%标签率下,相比最优基线宏平均F1提升2.75%和2.2%
  • 适用于节点特征缺失的复杂异构图场景

在图自监督学习中,掩码自编码器(MAE)和对比学习(CL)是两种主流范式。MAE侧重于重建被掩码的元素,而CL则通过增强图视图间的相似性来学习表示。近期研究指出二者具有互补性:MAE擅长捕捉局部特征,而CL擅长提取全局信息。尽管已有针对同构图的混合框架,但在设计同时满足两类任务语义需求的共享编码器方面仍存在挑战。在语义稀疏场景下,传统方法难以构建有效视图,且正负样本间梯度不平衡问题持续存在。本文提出HetCRF,一种新颖的双通道自监督学习框架,专为异构图设计。该框架采用两阶段聚合策略,使嵌入语义适配两种任务。针对语义稀疏问题,通过增强编码器输出来改进视图构建,而非依赖原始特征,提升了效率。此外,提出了两种正样本增强策略以平衡梯度贡献。在四个真实异构图数据集上的节点分类实验表明,HetCRF优于现有最先进基线。在Aminer和Freebase等节点特征缺失的数据集上,当标签率为40%时,宏平均F1分别提升2.75%和2.2%,验证了其有效性与优越性。

原文摘要 · Abstract (English)

In graph self-supervised learning, masked autoencoders (MAE) and contrastive learning (CL) are two prominent paradigms. MAE focuses on reconstructing masked elements, while CL maximizes similarity between augmented graph views. Recent studies highlight their complementarity: MAE excels at local feature capture, and CL at global information extraction. Hybrid frameworks for homogeneous graphs have been proposed, but face challenges in designing shared encoders to meet the semantic requirements of both tasks. In semantically sparse scenarios, CL struggles with view construction, and gradient imbalance between positive and negative samples persists. This paper introduces HetCRF, a novel dual-channel self-supervised learning framework for heterogeneous graphs. HetCRF uses a two-stage aggregation strategy to adapt embedding semantics, making it compatible with both MAE and CL. To address semantic sparsity, it enhances encoder output for view construction instead of relying on raw features, improving efficiency. Two positive sample augmentation strategies are also proposed to balance gradient contributions. Node classification experiments on four real-world heterogeneous graph datasets demonstrate that HetCRF outperforms state-of-the-art baselines. On datasets with missing node features, such as Aminer and Freebase, at a 40% label rate in node classification, HetCRF improves the Macro-F1 score by 2.75% and 2.2% respectively compared to the second-best baseline, validating its effectiveness and superiority.

异构图自监督学习对比学习图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。