用简单路径计数提升图Transformer的结构表达能力
Simple Path Structural Encoding for Graph Transformers
- 通过统计边所在的简单路径数量进行结构编码
- 在分子和长程图数据集上显著优于随机游走编码
- 特别擅长捕捉局部环状结构,适合图神经网络研究者
图Transformer将全局自注意力机制扩展到图结构数据,在图学习中取得显著成功。近期发现,随机游走结构编码(RWSE)通过将结构与位置信息编码到边表示中,进一步提升了模型性能。然而,RWSE难以区分属于不同局部图模式的边,限制了其对图结构复杂性的刻画能力。本文提出一种新方法——简单路径结构编码(SPSE),利用边所在简单路径的数量进行编码。理论上和实验上均证明,SPSE克服了RWSE的局限性,能更丰富地表征图结构,尤其在捕捉局部环状模式方面表现优异。为使SPSE计算可行,我们设计了一种高效的近似路径计数算法。在多个基准测试中,包括分子和长程图数据集,SPSE相较RWSE实现显著性能提升,且在可区分任务中达到统计显著性。结果表明,SPSE是增强图Transformer表达力的有力边编码方案。
原文摘要 · Abstract (English)
Graph transformers extend global self-attention to graph-structured data, achieving notable success in graph learning. Recently, random walk structural encoding (RWSE) has been found to further enhance their predictive power by encoding both structural and positional information into the edge representation. However, RWSE cannot always distinguish between edges that belong to different local graph patterns, which reduces its ability to capture the full structural complexity of graphs. This work introduces Simple Path Structural Encoding (SPSE), a novel method that utilizes simple path counts for edge encoding. We show theoretically and experimentally that SPSE overcomes the limitations of RWSE, providing a richer representation of graph structures, particularly for capturing local cyclic patterns. To make SPSE computationally tractable, we propose an efficient approximate algorithm for simple path counting. SPSE demonstrates significant performance improvements over RWSE on various benchmarks, including molecular and long-range graph datasets, achieving statistically significant gains in discriminative tasks. These results pose SPSE as a powerful edge encoding alternative for enhancing the expressivity of graph transformers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。