arXiv:2607.28259cs.LGmath.AT2026-07

将图的拓扑结构转为序列,用注意力模型高效学习图表示

TopoFormer: Topology Meets Attention for Graph Learning

论文配图:TopoFormer: Topology Meets Attention for Graph Learning
图 1 · 摘自论文原文
  • 通过拓扑扫描将图分解为有序拓扑标记序列
  • 在多个图分类和分子性质预测任务上达到顶尖性能
  • 计算高效且可并行,适合集成到主流深度学习框架

我们提出 Topoformer,一个轻量且可扩展的图表示学习框架,将拓扑结构编码为适配注意力机制的序列。核心是 Topo-Scan 模块,通过节点或边过滤切片,将图分解为短而有序的拓扑标记序列,捕捉从局部模式到全局组织的多尺度结构特征,并由 Transformer 生成丰富的图级嵌入。与传统持久同调流程不同,Topo-Scan 可并行处理,避免昂贵的图示计算,且可无缝集成至标准深度学习架构。我们提供了拓扑编码稳定性的理论保证,并在图分类和分子性质预测基准上展示出领先性能。结果表明,Topoformer 在保持可预测、高效计算的同时,表现媲美甚至超越强基线的 GNN 和拓扑方法。本工作为融合拓扑先验与注意力框架的可并行统一方法开辟新路径。

原文摘要 · Abstract (English)

We introduce Topoformer, a lightweight and scalable framework for graph representation learning that encodes topological structure into attention-friendly sequences. At the core of our method is Topo-Scan, a novel module that decomposes a graph into a short, ordered sequence of topological tokens by slicing over node or edge filtrations. These sequences capture multi-scale structural patterns, from local motifs to global organization, and are processed by a Transformer to produce expressive graph-level embeddings. Unlike traditional persistent homology pipelines, Topo-Scan is parallelizable, avoids costly diagram computations, and integrates seamlessly with standard deep learning architectures. We provide theoretical guarantees on the stability of our topological encodings and demonstrate state-of-the-art performance across graph classification and molecular property prediction benchmarks. Our results show that Topoformer matches or exceeds strong GNN and topology-based baselines while offering predictable and efficient compute. This work opens a new path for parallelizable and unifying approaches to graph representation learning that integrate topological inductive biases into attention frameworks.

图学习拓扑注意力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。