arXiv:2602.09258cs.LG2026-02KDD被引 1

通过分词专家混合提升GNN在分布偏移下的稳定性与泛化能力

Generalizing GNNs with Tokenized Mixture of Experts

  • 引入分词专家混合架构,实现多路径计算与动态路由
  • 在九个基准上同时提升对度/同质性偏移和噪声的鲁棒性
  • 适合需要高稳定性与泛化性的实际图数据应用

部署的图神经网络在推理时固定不变,却需适应干净数据、应对分布偏移并保持对扰动的稳定性。我们发现静态推理导致根本性权衡:提升稳定性需弱化对易变特征的依赖,从而留下不可消除的最差情况泛化下限。实例条件路由可突破此下限,但脆弱——分布偏移可能误导路由,扰动则引发路由波动。我们通过两种分解揭示其影响:覆盖性与选择性分离,基础敏感性与波动放大分离。基于此,提出STEM-GNN:一种预训练-微调框架,包含专家混合编码器以支持多样化计算路径,向量量化分词接口稳定编码器到头部信号,以及利普希茨正则化头部以限制输出放大。在九个节点、链接和图级别的基准测试中,STEM-GNN实现了更强的三者平衡,在度/同质性偏移及特征/边噪声下表现更优,同时在干净图上保持竞争力。

原文摘要 · Abstract (English)

Deployed graph neural networks (GNNs) are frozen at deployment yet must fit clean data, generalize under distribution shifts, and remain stable to perturbations. We show that static inference induces a fundamental tradeoff: improving stability requires reducing reliance on shift-sensitive features, leaving an irreducible worst-case generalization floor. Instance-conditional routing can break this ceiling, but is fragile because shifts can mislead routing and perturbations can make routing fluctuate. We capture these effects via two decompositions separating coverage vs selection, and base sensitivity vs fluctuation amplification. Based on these insights, we propose STEM-GNN, a pretrain-then-finetune framework with a mixture-of-experts encoder for diverse computation paths, a vector-quantized token interface to stabilize encoder-to-head signals, and a Lipschitz-regularized head to bound output amplification. Across nine node, link, and graph benchmarks, STEM-GNN achieves a stronger three-way balance, improving robustness to degree/homophily shifts and to feature/edge corruptions while remaining competitive on clean graphs.

图神经网络专家混合鲁棒性泛化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。