arXiv:2608.09031cs.LG2026-08

提出可学习的跳步提取机制,提升长程图表示学习效果

HOPPER: Learnable Hop Extraction for Linearized Graph Sequence Models

论文配图:HOPPER: Learnable Hop Extraction for Linearized Graph Sequence Models
图 1 · 摘自论文原文
  • 设计可学习的跳步序列提取器,动态适应图结构与节点特征
  • 在ECHO-Synth上达到顶尖性能,在物理长程依赖任务中优化记忆窗口提升精度
  • 支持结构感知与任务自适应,适用于复杂图数据建模

图神经网络通常通过重复的消息传递层传播信息,导致信息传播距离与非线性变换次数耦合,使深层模型难以优化,并引发过平滑、过挤压及长程信息丢失。线性化图序列模型(LGSM)通过将信息深度与处理深度分离,将每个节点的连续传播状态视为序列来缓解该问题。然而,现有LGSM使用固定的图算子构建序列,无法根据输入图、节点特征或下游任务自适应调整传播方式。本文提出HOPPER,一种端到端可学习的LGSM扩展框架,可学习如何在状态空间模型处理前提取跳步序列。该框架支持特征条件化、结构感知、图与跳步自适应的传播机制,同时保持置换等变性。基于邻接矩阵和非回溯的LGSM序列均为其提取族的特例。实验表明,HOPPER在ECHO-Synth基准上达到当前最优或具有竞争力,且调整消息回溯取消的最大邻域大小(即结构记忆窗口)可优化LRIM物理基长程依赖任务的准确率。结果表明,可学习序列提取为长程图表示学习提供了灵活有效的路径。

原文摘要 · Abstract (English)

Graph neural networks typically propagate information through repeated message-passing layers, coupling the distance over which information travels with the number of nonlinear transformations applied. This coupling can make deep architectures difficult to optimize and can lead to over-smoothing, over-squashing, and the loss of long-range information. Linearized Graph Sequence Models (LGSMs) address this issue by separating information depth from processing depth and treating the successive propagation states of each node as a sequence. However, existing LGSMs construct these sequences using fixed graph operators, limiting their ability to adapt propagation to the input graph, node features, and downstream task. We introduce HOPPER, an end-to-end learnable extension of LGSM that learns how hop sequences should be extracted before they are processed by a modern state-space model. Our framework supports feature-conditioned, structure-aware, graph- and hop-adaptive propagation mechanisms while preserving permutation equivariance. Standard adjacency-based and non-backtracking LGSM sequences arise as special cases of our proposed extractor family. We show that HOPPER is state-of-the-art or competitive across the ECHO-Synth benchmark, and that varying the maximum neighborhood size of message backtracking cancellation (i.e. structural memory window) can optimize accuracy on the LRIM physics-based long-range dependency benchmark. These results demonstrate that learnable sequence extraction provides a flexible and effective approach to long-range graph representation learning.

图神经网络长程依赖可学习序列

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。