arXiv:2511.11081cs.LGcs.SI2025-11AAAI被引 2

解决异构图学习中标签泄漏问题,实现高效低内存预计算。

Echoless Label-Based Pre-computation for Memory-Efficient Heterogeneous Graph Learning

  • 通过分区无回声传播消除多跳消息传递中的标签泄露
  • 在多个公开数据集上优于基线方法,保持低内存占用
  • 适合大规模异构图学习,兼容各类消息传递机制

异构图神经网络(HGNNs)广泛用于异构图的深度学习。传统端到端HGNN在训练时需重复消息传递,限制了大规模真实图的效率。基于预计算的HGNN通过预处理阶段仅一次消息传递,将邻居信息整合为规则张量,支持高效小批量训练。基于标签的预计算方法虽收集邻居标签信息,但存在训练标签泄露问题——节点自身标签在多跳消息传递中回传自身,产生回声效应。现有缓解策略在大图上内存效率低,或与先进消息传递方法不兼容。本文提出无回声标签预计算(Echoless-LP),采用分区聚焦无回声传播(PFEP),将目标节点分组,每组节点仅从其他组邻居收集标签信息,避免回声同时保持内存效率,并兼容任意消息传递方法。还引入非对称分区方案(APS)和后调整机制(PostAdjust),缓解分区导致的信息损失与组间分布偏移。在公开数据集上的实验表明,Echoless-LP在性能和内存效率上均优于基线。

原文摘要 · Abstract (English)

Heterogeneous Graph Neural Networks (HGNNs) are widely used for deep learning on heterogeneous graphs. Typical end-to-end HGNNs require repetitive message passing during training, limiting efficiency for large-scale real-world graphs. Pre-computation-based HGNNs address this by performing message passing only once during preprocessing, collecting neighbor information into regular-shaped tensors, which enables efficient mini-batch training. Label-based pre-computation methods collect neighbors' label information but suffer from training label leakage, where a node's own label information propagates back to itself during multi-hop message passing - the echo effect. Existing mitigation strategies are memory-inefficient on large graphs or suffer from compatibility issues with advanced message passing methods. We propose Echoless Label-based Pre-computation (Echoless-LP), which eliminates training label leakage with Partition-Focused Echoless Propagation (PFEP). PFEP partitions target nodes and performs echoless propagation, where nodes in each partition collect label information only from neighbors in other partitions, avoiding echo while remaining memory-efficient and compatible with any message passing method. We also introduce an Asymmetric Partitioning Scheme (APS) and a PostAdjust mechanism to address information loss from partitioning and distributional shifts across partitions. Experiments on public datasets demonstrate that Echoless-LP achieves superior performance and maintains memory efficiency compared to baselines.

异构图预计算标签泄露内存效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。