arXiv:2502.16454cs.LG2025-02被引 1

用Mamba提升异构稀疏图的表示能力,解决信息压缩和过平滑问题。

MAPN: Enhancing Heterogeneous Sparse Graph Representation by Mamba-based Asynchronous Aggregation

  • 基于元路径随机游走生成节点序列,用Mamba异步聚合多跳语义信息。
  • 在多个数据集上优于主流方法,显著缓解深层网络退化现象。
  • 适合处理大规模稀疏异构图,如社交网络、知识图谱等场景。

图神经网络(GNN)在各类图任务中表现优异,尤其在异构图(HetGs)中尤为突出。然而,现有方法面临三大挑战:难以充分捕捉长距离信息(过压缩);过多消息传递层导致表示趋同(过平滑);传统MPNN难以高效训练大规模稀疏图。为应对这些难题,本文提出基于Mamba的异步传播网络(MAPN),用于增强大规模异构稀疏图的表示能力。MAPN包含两个核心模块:节点序列生成与语义信息聚合。首先,基于元路径通过随机游走生成节点序列,作为空间状态模型的基础,从不同距离提取关键信息;随后,异步聚合多跳及多层语义信息,有效保留节点独特特征,缓解深层网络退化。大量实验表明,MAPN在多种下游任务中均表现出色,显著提升了异构稀疏图的图嵌入效果。

原文摘要 · Abstract (English)

Graph neural networks (GNNs) have become the state of the art for various graph-related tasks and are particularly prominent in heterogeneous graphs (HetGs). However, several issues plague this paradigm: first, the difficulty in fully utilizing long-range information, known as over-squashing; second, the tendency for excessive message-passing layers to produce indistinguishable representations, referred to as over-smoothing; and finally, the inadequacy of conventional MPNNs to train effectively on large sparse graphs. To address these challenges in deep neural networks for large-scale heterogeneous graphs, this paper introduces the Mamba-based Asynchronous Propagation Network (MAPN), which enhances the representation of heterogeneous sparse graphs. MAPN consists of two primary components: node sequence generation and semantic information aggregation. Node sequences are initially generated based on meta-paths through random walks, which serve as the foundation for a spatial state model that extracts essential information from nodes at various distances. It then asynchronously aggregates semantic information across multiple hops and layers, effectively preserving unique node characteristics and mitigating issues related to deep network degradation. Extensive experiments across diverse datasets demonstrate the effectiveness of MAPN in graph embeddings for various downstream tasks underscoring its substantial benefits for graph representation in large sparse heterogeneous graphs.

图神经网络异构图Mamba稀疏图

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。