提出几何索引准则,破解张量神经网络过平滑难题
Demystifying Oversmoothing in Sheaf Neural Networks: An Index-Theoretic Criterion

- 用拓扑索引对比方法,精准衡量张量网络抗过平滑能力
- 理论证明:符合准则的模型能保持深层表示稳定
- 适用于需要深度图学习的科研与工业场景
为应对图卷积网络中的过平滑问题,张量神经网络(SNNs)通过引入张量结构并以张量拉普拉斯算子替代图拉普拉斯算子进行改进。现有分析依赖于调和空间(kerℒ)的绝对维数作为抗过平滑能力指标,但该指标不可靠:某些张量配置虽增大dim kerℒ,其调和截面仍全为常数,未提升判别能力。本文首次提出相对几何方法,建立索引理论比较准则,在自然条件下证明一个张量的调和空间可真正包含另一个,而非仅因膨胀。通过具体实例验证,并引入基于双曲向量空间的GyroSheaf模型,利用局部切线线性化将准则拓展至非线性场景。在十种模型上的实验表明:违反准则的模型即使存在索引跃升也会坍塌,而符合准则的模型能维持深度稳定的表征。
原文摘要 · Abstract (English)
To combat oversmoothing in Graph Convolutional Networks, Sheaf Neural Networks (SNNs) were proposed as a generalization by equipping the graph with a sheaf structure and replacing the graph Laplacian with a sheaf Laplacian $\mathcal{L}$. Existing analyses connect sheaf diffusion to oversmoothing via the harmonic space ($\ker\mathcal{L}$), taking its absolute dimension as an indicator of anti-oversmoothing capacity. However, absolute dimension alone is not a reliable measure: certain sheaf configurations inflate $\dim \ker \mathcal{L}$ while their harmonic sections remain entirely constant, without enriching discriminative capacity. We instead introduce the first relative, geometric approach, yielding a precise characterisation of anti-oversmoothing capacity. Under natural conditions on stalk transportation and global sheaf structure, we establish an index-theoretic comparison criterion showing that one sheaf's harmonic space genuinely contains another's beyond trivial inflation. We illustrate this with a concrete instance and further introduce \textit{GyroSheaf}, a sheaf with curved gyrovector-space stalks, extending the criterion to the non-linear setting via local tangent-space linearization. Experiments across ten models confirm the theoretical criterion: sheaf models violating the criterion collapse despite possessing index jumps, while compliant models maintain depth-stable representations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。