提出新型图神经网络,让相似节点更关注彼此
Neighbourhood Transformer: Switchable Attention for Monophily-Aware Graph Learning
- 在局部邻域内用自注意力机制替代传统消息传递
- 在10个真实数据集上均超越现有最优方法
- 适配大图部署,内存降低95%以上,适合工业应用
图神经网络在社交网络分析、化学研究和计算机视觉等工程应用中广泛使用,但其性能受固有同质性假设限制,难以处理异质图(即不相似节点常相连)。为此,本文受真实图中发现的单向性(monophily)特性启发,提出邻域变换器(Neighbourhood Transformer, NT),将自注意力机制应用于每个局部邻域,而非传统消息传递中向中心节点聚合信息。该设计使模型天然具备单向性感知能力,并理论上保证表达能力不低于传统消息传递框架。为提升工程实用性,进一步设计了带可切换注意力的邻域划分策略,使NT的空间开销降低超过95%,时间开销减少高达92.67%,显著扩展其在大规模图上的适用性。在10个真实数据集(5个异质图与5个同质图)上的大量实验表明,NT在节点分类任务上优于所有现有最先进方法,展现出卓越性能与跨领域适应性。完整代码已公开于https://github.com/cf020031308/MoNT,便于复现与工业落地。
原文摘要 · Abstract (English)
Graph neural networks (GNNs) have been widely adopted in engineering applications such as social network analysis, chemical research and computer vision. However, their efficacy is severely compromised by the inherent homophily assumption, which fails to hold for heterophilic graphs where dissimilar nodes are frequently connected. To address this fundamental limitation in graph learning, we first draw inspiration from the recently discovered monophily property of real-world graphs, and propose Neighbourhood Transformers (NT), a novel paradigm that applies self-attention within every local neighbourhood instead of aggregating messages to the central node as in conventional message-passing GNNs. This design makes NT inherently monophily-aware and theoretically guarantees its expressiveness is no weaker than traditional message-passing frameworks. For practical engineering deployment, we further develop a neighbourhood partitioning strategy equipped with switchable attentions, which reduces the space consumption of NT by over 95% and time consumption by up to 92.67%, significantly expanding its applicability to larger graphs. Extensive experiments on 10 real-world datasets (5 heterophilic and 5 homophilic graphs) show that NT outperforms all current state-of-the-art methods on node classification tasks, demonstrating its superior performance and cross-domain adaptability. The full implementation code of this work is publicly available at https://github.com/cf020031308/MoNT to facilitate reproducibility and industrial adoption.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。