arXiv:2511.16101cs.LGeess.SP2025-11

提出混合域图神经网络HybSpecNet,解决自适应模型易崩溃的问题。

HybSpecNet: A Critical Analysis of Architectural Instability in Hybrid-Domain Spectral GNNs

  • 设计双分支结构:稳定分支(ChebyNet)+ 自适应分支(KrawtchoukNet)
  • 发现简单拼接会导致梯度爆炸,在K=25时性能彻底崩溃
  • 采用延迟融合机制隔离梯度路径,稳定至K=30仍保持最优性能

谱图神经网络虽具理论优势,但面临‘稳定性与自适应性’的权衡。有限区间[-1,1]域滤波器(如ChebyNet)数值稳定但静态低通,难以处理异质图;半无限区间[0,∞)域滤波器(如KrawtchoukNet)自适应强,已在异质图上达到领先性能。然而我们发现,这些自适应滤波器在高多项式阶数K下也会出现数值不稳定,导致灾难性性能下降。本文提出混合域图神经网络HybSpecNet,结合两者分支。初步实验表明,简单拼接能统一低K下的表现,但在K=25时遭遇与KrawtchoukNet相同的崩溃。我们揭示此现象为‘不稳定性污染’——自适应分支产生的NaN/Inf梯度破坏整体训练。为此提出‘延迟融合’架构,完全隔离梯度路径,实现从K=1到K=30全程稳定,同时保持全类型图上的最先进性能。本工作识别出混合架构关键缺陷并提供鲁棒解决方案。

原文摘要 · Abstract (English)

Spectral Graph Neural Networks offer a principled approach to graph filtering but face a fundamental "Stability-vs-Adaptivity" trade-off. This trade-off is dictated by the choice of spectral domain. Filters in the finite [-1, 1] domain (e.g., ChebyNet) are numerically stable at high polynomial degrees (K) but are static and low-pass, causing them to fail on heterophilic graphs. Conversely, filters in the semi-infinite [0, infty) domain (e.g., KrawtchoukNet) are highly adaptive and achieve SOTA results on heterophily by learning non-low-pass responses. However, as we demonstrate, these adaptive filters can also suffer from numerical instability, leading to catastrophic performance collapse at high K. In this paper, we propose to resolve this trade-off by designing a hybrid-domain GNN, HybSpecNet, which combines a stable `ChebyNet` branch with an adaptive `KrawtchoukNet` branch. We first demonstrate that a "naive" hybrid architecture, which fuses the branches via concatenation, successfully unifies performance at low K, achieving strong results on both homophilic and heterophilic benchmarks. However, we then prove that this naive architecture fails the stability test. Our K-ablation experiments show that this architecture catastrophically collapses at K=25, exactly mirroring the collapse of its unstable `KrawtchoukNet` branch. We identify this critical finding as "Instability Poisoning," where `NaN`/`Inf` gradients from the adaptive branch destroy the training of the model. Finally, we propose and validate an advanced architecture that uses "Late Fusion" to completely isolate the gradient pathways. We demonstrate that this successfully solves the instability problem, remaining perfectly stable up to K=30 while retaining its SOTA performance across all graph types. This work identifies a critical architectural pitfall in hybrid GNN design and provides the robust architectural solution.

图神经网络谱方法稳定性混合架构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。