arXiv:2602.22645cs.LG2026-02AAAI被引 5

MUG让通用图模型学会处理复杂异构图,提升跨数据集泛化能力。

MUG: Meta-path-aware Universal Heterogeneous Graph Pre-Training

  • 通过统一输入与维度感知编码,对异构图进行统一表征
  • 在多个真实数据集上实现显著优于基线的下游任务性能
  • 适合需要跨异构图迁移学习的研究者和工业应用

通用图预训练已成为图表示学习的关键范式,能够从无标签图中训练可迁移的编码器,并有效泛化到多种下游任务。然而,现有研究主要聚焦于同质图,异构图的通用预训练仍处于空白。异构图具有更高的结构与语义复杂性,带来两大挑战:(i) 不同类型节点与关系的语义差异阻碍了统一表示空间的构建;(ii) 跨数据集的元路径数量与语义不一致,导致聚合模式难以通用。为此,我们提出元路径感知的通用异构图预训练方法MUG。针对问题(i),MUG设计输入统一模块,将异构图中多类型节点与关系信息融合为统一表征,并通过维度感知编码器投影至共享空间,实现不同模式图间的对齐。针对问题(ii),MUG训练一个共享编码器,捕捉跨元路径视图的一致结构模式,而非依赖数据集特定聚合策略,同时采用全局目标增强判别性并降低数据集偏见。大量实验验证了MUG在多个真实数据集上的有效性。

原文摘要 · Abstract (English)

Universal graph pre-training has emerged as a key paradigm in graph representation learning, offering a promising way to train encoders to learn transferable representations from unlabeled graphs and to effectively generalize across a wide range of downstream tasks. However, recent explorations in universal graph pre-training primarily focus on homogeneous graphs and it remains unexplored for heterogeneous graphs, which exhibit greater structural and semantic complexity. This heterogeneity makes it highly challenging to train a universal encoder for diverse heterogeneous graphs: (i) the diverse types with dataset-specific semantics hinder the construction of a unified representation space; (ii) the number and semantics of meta-paths vary across datasets, making encoding and aggregation patterns learned from one dataset difficult to apply to others. To address these challenges, we propose a novel Meta-path-aware Universal heterogeneous Graph pre-training (MUG) approach. Specifically, for challenge (i), MUG introduces a input unification module that integrates information from multiple node and relation types within each heterogeneous graph into a unified representation.This representation is then projected into a shared space by a dimension-aware encoder, enabling alignment across graphs with diverse schemas.Furthermore, for challenge (ii), MUG trains a shared encoder to capture consistent structural patterns across diverse meta-path views rather than relying on dataset-specific aggregation strategies, while a global objective encourages discriminability and reduces dataset-specific biases. Extensive experiments demonstrate the effectiveness of MUG on some real datasets.

图神经网络异构图预训练元路径

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。