arXiv:2607.03798cs.LGcs.AI2026-07中稿 · ICML被引 1

统一图神经网络与层神经网络,用对称性理论构建更通用的深度学习框架。

Foundations of Equivariant Deep Learning: Unifying Graph and Sheaf Neural Networks

  • 基于面序集上的等变向量丛理论,构建顺序等变神经网络(OENN)
  • 证明连续顺序等变映射的通用逼近定理,覆盖图与层模型
  • 为几何与拓扑深度学习提供统一范式,适合研究对称性建模者

对称性存在于自然与社会中。几何深度学习构建尊重群对称性的架构,而拓扑深度学习则通过胞腔、关联关系和局部到全局结构组织计算。本文将几何深度学习拓展至复杂对称性,并与拓扑深度学习统一。我们提出顺序等变神经网络(OENN),通过面序集(face posets)上的等变向量丛理论,推广标准图消息传递与层神经网络。具体贡献包括:(i) 揭示所有线性顺序等变映射的结构,(ii) 构建OENN层,(iii) 证明连续顺序等变映射的通用逼近定理(UAT),该结果在限制到层神经网络时亦为新发现。我们在图与层模型上验证框架有效性。结果亦可视为将图神经网络的已知UAT扩展至更一般设置,涵盖层神经网络。附录中,我们展示OENN可通过作用群胚的格罗滕迪克构造与CENN(类别等变神经网络)关联,给出等变神经网络的范畴论统一形式,使数据中的范畴对称性得以利用,推动几何深度学习从群对称性扩展至变换范畴。

原文摘要 · Abstract (English)

Symmetry is everywhere in nature and society. Geometric deep learning builds architectures respecting group symmetries, whereas topological deep learning organizes computation through cells, incidence relations, and local-to-global structure. In this paper, we extend geometric deep learning beyond simple group actions and unify it with topological deep learning. Specifically, we develop order-equivariant neural networks (OENN), which generalize standard graph message passing and sheaf neural networks via the theory of equivariant vector bundles over face posets (or face categories). We (i) characterize all linear order-equivariant maps, (ii) build OENN layers, and (iii) prove universal approximation theorems (UATs) for continuous order-equivariant maps, which are new results even when restricted to sheaf neural networks. We illustrate the framework on graph and sheaf models. Our results can also be seen as extending the known UAT for graph neural networks to a more general setting that subsumes sheaf neural networks as well. In the appendix, we show that OENN can be connected, via the action groupoid Grothendieck construction, to CENN (category-equivariant neural network), which gives the categorical general form of equivariant neural networks, allowing us to leverage categorical symmetry in data and extending geometric deep learning from groups of symmetries to categories of transformations.

等变学习图神经网络层网络范畴论

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。