arXiv:2605.12358cs.LG2026-05被引 1

将图神经网络重新构想为序列模型,提升长距离信息建模能力。

From Message-Passing to Linearized Graph Sequence Models

论文配图:From Message-Passing to Linearized Graph Sequence Models
图 1 · 摘自论文原文
  • 从序列建模视角重构图计算,分离处理深度与信息传播深度。
  • 在长程依赖任务上性能提升,验证了序列特性对图归纳偏置的有效性。
  • 适合关注图学习架构设计与序列模型融合的研究者。

基于消息传递的方法构成了图结构数据学习架构的主流范式。然而,现代深度学习在其他领域(尤其是序列建模)的快速发展,引发了一个问题:图学习能否从中受益?本文提出线性化图序列模型(Linearized Graph Sequence Models),从序列建模的角度重构消息传递的图计算,简化架构选择。该方法系统地分离了计算处理深度与信息传播深度,使核心图架构决策可转化为序列建模的选择。我们通过实验和理论分析,研究了哪些序列属性能有效学习并保持图的归纳偏置。特别地,我们的实证结果表明,在处理长距离信息任务时性能显著提升。这些发现为将现代序列建模进展融入基于消息传递的图学习提供了原则性路径。此外,本工作还展示了处理深度与信息深度分离如何将关键架构问题转化为输入建模选择。

原文摘要 · Abstract (English)

Message-passing based approaches form the default backbone of most learning architectures on graph-structured data. However, the rapid progress of modern deep learning architectures in other domains, particularly sequence modeling, raises the question of how graph learning can benefit from these advances. We introduce Linearized Graph Sequence Models, a framework that recasts message-passing graph computation from the perspective of sequence modeling to simplify architectural choices. Our approach systematically separates the computational processing depth from the information propagation depth, allowing core graph architectural decisions to be treated as sequence modeling choices. Specifically, we analyze, both empirically and theoretically, what sequence properties make methods effective for learning and preserving the graph inductive bias. In particular, we validate our findings, demonstrating improved performance on long-range information tasks in graphs. Our findings provide a principled way to integrate modern sequence modeling advances into message-passing based graph learning. Beyond this, our work demonstrates how the separation of processing and information depth can recast central architectural questions as input modeling choices.

图神经网络序列建模架构设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。