arXiv:2606.01660cs.LG2026-06

提出新型图神经网络架构,实现节点与通道联合自适应滤波,提升预传播模型性能。

Gate the Filter, Not the Message: Node-Channel Mixtures for Pre-Propagation GNNs

论文配图:Gate the Filter, Not the Message: Node-Channel Mixtures for Pre-Propagation GNNs
图 1 · 摘自论文原文
  • 设计3D门控混合专家结构,同时适配节点和通道的滤波需求。
  • 在11个基准上9次超越基线,大模型平均提升1.53分。
  • 适合追求高效可扩展图学习的工程师和研究者。

预传播图神经网络(PPGNN)将所有图相关计算移至预处理阶段,仅在生成的密集邻域特征上训练,因而具有极高可扩展性。然而,复杂邻域聚合器并未稳定优于简单方法:许多基准上,基于MLP的聚合器表现与基于邻域注意力的变体相当甚至更优。本文从图滤波视角重新审视该现象。在预计算的扩散基下,现有PPGNN主要差异在于滤波系数在节点与特征通道间的共享方式,而非聚合器容量本身。MLP架构学习的是通道依赖但节点共享的滤波器,而邻域注意力架构学习的是节点依赖但通道共享的混合。这揭示了标准设计中缺失的一环:在预传播框架下实现节点与通道双重自适应滤波。本文提出FilterMoE,一种基于可学习切比雪夫滤波专家的混合专家模型,通过三维门控张量联合路由节点与通道。在11个同质与异质基准上,FilterMoE在9个数据集上优于强基线,在三个大规模基准上均排名第一,平均测试得分提升1.53分。结果表明,联合节点-通道滤波路由是替代特定数据集聚合器选择的稳健方案。

原文摘要 · Abstract (English)

Pre-propagation graph neural networks (PPGNNs) push all graph-dependent computation into a preprocessing step and train only on the resulting dense hop features, which makes them highly scalable. A puzzle in this regime is that more complex hop aggregators do not reliably outperform simpler ones: on many benchmarks, a plain MLP-based aggregator matches or beats hop-attention variants. We revisit this behavior from a graph-filter perspective. Over a precomputed diffusion basis, existing PPGNNs differ mainly in how filter coefficients are shared across nodes and feature channels, rather than simply in raw aggregator capacity. MLP-based architectures learn channel-dependent filters that are largely shared across nodes, while hop-attention-based architectures learn node-dependent mixtures that are largely shared across channels. This reveals a missing regime in standard PPGNN designs: joint node- and channel-adaptive filtering under the pre-propagation computational contract. We propose FilterMoE, a mixture-of-experts PPGNN in which a small bank of learnable Chebyshev filter experts is routed jointly over nodes and channels by a 3D gating tensor. Across eleven homophilic and heterophilic benchmarks, FilterMoE outperforms strong PPGNN baselines on nine datasets and ranks first on all three large-scale benchmarks, improving the average test score by 1.53 points. These results establish joint node-channel filter routing as a robust alternative to dataset-specific hop-aggregator selection.

图神经网络预传播混合专家滤波器设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。