arXiv:2603.05395cs.LG2026-03被引 4

发现无需学习的流形拉普拉斯也能在异质图上有效防过平滑。

On the Necessity of Learnable Sheaf Laplacians

  • 用固定恒等限制映射构造基线模型,验证学习流形的必要性
  • 五个异质图基准上性能与可学习流形网络相当
  • 实证表明理论预测的扩散行为未在训练模型中出现

流形神经网络(SNN)通过在图上附着流形并用可学习的限制映射定义流形拉普拉斯来缓解异质图上的过平滑问题。尽管已有理论支持非恒等限制映射能避免表示收敛为常数,但残差连接和归一化也具备类似能力。本文引入恒等流形网络基线(所有限制映射固定为恒等),在五个主流异质图基准上进行消融实验,结果表明其性能与多种SNN变体相当。进一步引入瑞利商作为归一化指标比较模型过平滑程度,发现训练后网络的实际行为与基于扩散分析的理论预测不符:恒等流形网络并未表现出更严重的过平滑。这表明学习限制映射的额外复杂性可能并非必要。

原文摘要 · Abstract (English)

Sheaf Neural Networks (SNNs) were introduced as an extension of Graph Convolutional Networks to address oversmoothing on heterophilous graphs by attaching a sheaf to the input graph and replacing the adjacency-based operator with a sheaf Laplacian defined by (learnable) restriction maps. Prior work motivates this design through theoretical properties of sheaf diffusion and the kernel of the sheaf Laplacian, suggesting that suitable non-identity restriction maps can avoid representations converging to constants across connected components. Since oversmoothing can also be mitigated through residual connections and normalization, we revisit a trivial sheaf construction to ask whether the additional complexity of learning restriction maps is necessary. We introduce an Identity Sheaf Network baseline, where all restriction maps are fixed to the identity, and use it to ablate the empirical improvements reported by sheaf-learning architectures. Across five popular heterophilic benchmarks, the identity baseline achieves comparable performance to a range of SNN variants. Finally, we introduce the Rayleigh quotient as a normalized measure for comparing oversmoothing across models and show that, in trained networks, the behavior predicted by the diffusion-based analysis of SNNs is not reflected empirically. In particular, Identity Sheaf Networks do not appear to suffer more significant oversmoothing than their SNN counterparts.

图神经网络流形网络过平滑消融实验

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。