arXiv:2505.04340cs.LGcs.AI2025-05

用超图与多粒度注意力提升异构图表示学习效果

Multi-Granular Attention based Heterogeneous Hypergraph Neural Network

  • 构建多视角异构超图,捕捉节点间高阶语义关系
  • 通过多粒度注意力机制缓解长程信息失真问题
  • 适合需要精准建模复杂关系的图学习任务

异构图神经网络(HeteGNNs)在学习节点表示方面表现出强大能力,能有效提取异构图中的复杂结构和语义信息。现有主流方法遵循邻域聚合范式,依赖元路径驱动的消息传递来学习隐式节点表示,但因元路径的成对特性,难以捕捉节点间的高阶关系,导致性能受限。此外,长程消息传递引发的“过挤压”问题进一步限制了模型效能。为此,本文提出MGA-HHN:一种基于多粒度注意力的异构超图神经网络。该模型引入两项关键创新:(1)一种新的基于元路径的异构超图构建方法,通过多视角显式建模异构图中的高阶语义信息;(2)一种在节点与超边层级均适用的多粒度注意力机制,可捕捉同一超边类型内节点间的细粒度交互,同时保留不同超边类型间的语义多样性。MGA-HHN有效缓解长程信息失真,生成更具表现力的节点表示。在真实世界基准数据集上的大量实验表明,其在节点分类、聚类及可视化任务中均优于现有最先进模型。

原文摘要 · Abstract (English)

Heterogeneous graph neural networks (HeteGNNs) have demonstrated strong abilities to learn node representations by effectively extracting complex structural and semantic information in heterogeneous graphs. Most of the prevailing HeteGNNs follow the neighborhood aggregation paradigm, leveraging meta-path based message passing to learn latent node representations. However, due to the pairwise nature of meta-paths, these models fail to capture high-order relations among nodes, resulting in suboptimal performance. Additionally, the challenge of ``over-squashing'', where long-range message passing in HeteGNNs leads to severe information distortion, further limits the efficacy of these models. To address these limitations, this paper proposes MGA-HHN, a Multi-Granular Attention based Heterogeneous Hypergraph Neural Network for heterogeneous graph representation learning. MGA-HHN introduces two key innovations: (1) a novel approach for constructing meta-path based heterogeneous hypergraphs that explicitly models higher-order semantic information in heterogeneous graphs through multiple views, and (2) a multi-granular attention mechanism that operates at both the node and hyperedge levels. This mechanism enables the model to capture fine-grained interactions among nodes sharing the same semantic context within a hyperedge type, while preserving the diversity of semantics across different hyperedge types. As such, MGA-HHN effectively mitigates long-range message distortion and generates more expressive node representations. Extensive experiments on real-world benchmark datasets demonstrate that MGA-HHN outperforms state-of-the-art models, showcasing its effectiveness in node classification, node clustering and visualization tasks.

异构图超图神经网络多粒度注意力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。