用检索代替消息传递,让图神经网络更高效更鲁棒
Rethinking Message Passing as Retrieval for Text-Attributed Graph Learning

- 用标签感知的检索替代传统消息传递,简化模型结构
- 在多个文本图数据集上表现优于或媲美主流GNN和图LLM
- 对错误检索有强鲁棒性,计算效率更高,适合实际部署
图神经网络通常被看作消息传递网络,但为何邻域聚合比节点级MLP表现更好仍不明确。尽管效果显著,该范式计算开销大且对图结构不完美敏感。本文提出一种基于检索的GNN新视角:每一层通过MLP结合节点表示与可置换的检索上下文摘要进行预测。基于此,我们提出RTA——一个仅用MLP的简单框架,用标签感知的检索与传播替代结构化消息传递。理论分析表明:(i) 检索聚合等价于软注意力消息传递;(ii) 检索上下文监督对误检异常值具有鲁棒性。在多个文本属性图基准测试中,RTA匹配甚至超越强基线,同时提升效率与鲁棒性。
原文摘要 · Abstract (English)
Graph neural networks (GNNs) are typically conceptualized as message-passing neural networks, yet it remains unclear why neighborhood aggregation reliably outperforms node-wise multilayer perceptrons (MLPs). Despite its empirical success, this paradigm can be computationally expensive and sensitive to imperfect graph structures. In this work, we present a retrieval-augmented view of GNNs: each layer makes predictions by applying an MLP to a node representation together with a permutation-invariant summary of retrieved graph context. Motivated by this perspective, we propose RTA, a simple MLP-based framework that replaces structural message passing with label-aware retrieval and propagation. We provide theoretical insights that (i) connect retrieval-based aggregation to softmax-attention message passing, and (ii) establish the robustness of retrieved-context supervision to mis-retrieved outliers. Experiments on multiple text-attributed graph benchmarks show that RTA matches or even outperforms strong GNN and graph LLM baselines while improving efficiency and robustness across diverse scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。