arXiv:2603.03227cs.LG2026-03

用范畴论统一解释神经网络的对称性,让模型自动适应各类变换。

Coalgebras for categorical deep learning: Representability and universal approximation

  • 用余代数形式化对称性,统一处理不同神经网络架构
  • 证明连续对称函数可在该框架下被逼近,覆盖多种对称类型
  • 适合研究模型泛化与对称性设计的学者参考

范畴化深度学习(CDL)最近兴起,利用范畴论统一多种神经网络结构。与基于群作用不变性的几何深度学习不同,CDL旨在提供领域无关的抽象方法来推理模型及其性质。本文构建了对称表示的余代数基础,将群作用和等变映射自然推广为余代数形式。首个核心结果表明:给定从集合到向量空间的嵌入函子,以及在数据集上建模不变行为的集合自函子,存在一个对应的向量空间自函子,其在嵌入下保持兼容性,能恢复嵌入后数据上的等变行为。在此基础上,我们建立了该广义设置下的等变映射通用逼近定理,证明连续等变函数可被该框架逼近,适用于广泛的对称类型。本工作为抽象的不变性规范与神经架构的实现之间提供了范畴论桥梁。

原文摘要 · Abstract (English)

Categorical deep learning (CDL) has recently emerged as a framework that leverages category theory to unify diverse neural architectures. While geometric deep learning (GDL) is grounded in the specific context of invariants of group actions, CDL aims to provide domain-independent abstractions for reasoning about models and their properties. In this paper, we contribute to this program by developing a coalgebraic foundation for equivariant representation in deep learning, as classical notions of group actions and equivariant maps are naturally generalized by the coalgebraic formalism. Our first main result demonstrates that, given an embedding of data sets formalized as a functor from SET to VECT, and given a notion of invariant behavior on data sets modeled by an endofunctor on SET, there is a corresponding endofunctor on VECT that is compatible with the embedding in the sense that this lifted functor recovers the analogous notion of invariant behavior on the embedded data. Building on this foundation, we then establish a universal approximation theorem for equivariant maps in this generalized setting. We show that continuous equivariant functions can be approximated within our coalgebraic framework for a broad class of symmetries. This work thus provides a categorical bridge between the abstract specification of invariant behavior and its concrete realization in neural architectures.

范畴论对称性等变网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。