用同态计数构建图结构编码,提升图神经网络性能
Homomorphism Counts as Structural Encodings for Graph Learning
- 基于图同态计数设计新型结构编码框架
- 在分子属性预测任务上达到当前最好效果
- 适用于需要强结构感知的图学习场景
图Transformer是将Transformer架构扩展到图领域的流行神经网络。这类模型通过节点自注意力机制运行,并借助位置编码(如拉普拉斯位置编码)或结构编码(如随机游走结构编码)融入图结构信息。编码质量至关重要,因为它为模型提供必要的图归纳偏置。本文提出一种名为“基序结构编码”(MoSE)的灵活而强大的结构编码框架,基于图同态计数构建。理论上,我们比较了MoSE与随机游走结构编码的表达能力,并将其与标准消息传递神经网络的表达力关联。实验表明,MoSE在多种架构上优于现有知名的位置和结构编码,在广泛使用的分子属性预测数据集上达到最先进性能。
原文摘要 · Abstract (English)
Graph Transformers are popular neural networks that extend the well-known Transformer architecture to the graph domain. These architectures operate by applying self-attention on graph nodes and incorporating graph structure through the use of positional encodings (e.g., Laplacian positional encoding) or structural encodings (e.g., random-walk structural encoding). The quality of such encodings is critical, since they provide the necessary $\textit{graph inductive biases}$ to condition the model on graph structure. In this work, we propose $\textit{motif structural encoding}$ (MoSE) as a flexible and powerful structural encoding framework based on counting graph homomorphisms. Theoretically, we compare the expressive power of MoSE to random-walk structural encoding and relate both encodings to the expressive power of standard message passing neural networks. Empirically, we observe that MoSE outperforms other well-known positional and structural encodings across a range of architectures, and it achieves state-of-the-art performance on a widely studied molecular property prediction dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。