arXiv:2602.20370cs.LGcs.NA2026-02被引 2

量化了群等变神经网络的逼近能力,证明其与普通网络表达力相当。

Quantitative Approximation Rates for Group Equivariant Learning

  • 构建了多种等变架构的定量逼近速率分析框架
  • 在相同规模下,等变网络与普通MLP逼近能力无差异
  • 适用于需对称性约束的机器学习任务研究者

通用逼近定理表明神经网络可逼近任意紧集上的连续函数。后续研究给出了ReLU网络对α-霍尔德函数f: [0,1]^N → ℝ的定量逼近速率。本文旨在为具有群对称性的等变学习场景提供类似结果,即已知所学α-霍尔德函数满足特定群对称性。尽管学界广泛关注等变模型的通用逼近性质,但关于等变模型的定量逼近结果仍极为有限。本文通过推导多种典型等变与不变架构的定量逼近速率,填补了这一空白。所考虑的架构包括:置换不变的Deep Sets;置换等变的Sumformer与Transformer;基于帧平均的联合置换与刚体运动不变网络;以及一般双李普希茨不变模型。总体上,我们证明同等规模的ReLU MLP与等变架构在等变函数上的表达力相当,因此硬编码对称性不会导致表达力或逼近能力损失。

原文摘要 · Abstract (English)

The universal approximation theorem establishes that neural networks can approximate any continuous function on a compact set. Later works in approximation theory provide quantitative approximation rates for ReLU networks on the class of $α$-Hölder functions $f: [0,1]^N \to \mathbb{R}$. The goal of this paper is to provide similar quantitative approximation results in the context of group equivariant learning, where the learned $α$-Hölder function is known to obey certain group symmetries. While there has been much interest in the literature in understanding the universal approximation properties of equivariant models, very few quantitative approximation results are known for equivariant models. In this paper, we bridge this gap by deriving quantitative approximation rates for several prominent group-equivariant and invariant architectures. The architectures that we consider include: the permutation-invariant Deep Sets architecture; the permutation-equivariant Sumformer and Transformer architectures; joint invariance to permutations and rigid motions using invariant networks based on frame averaging; and general bi-Lipschitz invariant models. Overall, we show that equally-sized ReLU MLPs and equivariant architectures are equally expressive over equivariant functions. Thus, hard-coding equivariance does not result in a loss of expressivity or approximation power in these models.

等变学习逼近理论神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。