arXiv:2506.08244cs.LGcs.AI2025-06

用代数先验让网络近似等变,零参数却效果不输复杂模型。

Algebraic Priors for Approximately Equivariant Networks

  • 基于群表示论,用辅助损失强制引入正则表示作为先验
  • 在有限群上理论证明潜空间必含每个独立数据轨道的正则表示
  • 无需学习参数,适用于无限群,适合追求高效等变模型的研究者

等变神经网络通过群作用嵌入对称性,作为归纳偏置提升性能。现有方法或学习潜在空间中的等变作用,或设计构造性等变架构,常伴随架构特异性约束、参数量大和计算成本高等问题。本文挑战复杂等变架构范式,提出一种无参数的方法,基于群表示论构建基础代数洞察:对于有限群上的等变编码器,潜空间几乎必然包含每个线性独立数据轨道的正则表示。我们通过一系列实证研究验证该性质,并利用此洞察,通过辅助损失将群的正则表示作为归纳偏置引入,不增加任何可学习参数。大量评估表明,该方法在多个场景下表现匹配甚至优于专用模型,包括无限群情形。进一步消融实验验证了正则表示选择的优越性,其持续优于定义表示和平凡表示基线。

原文摘要 · Abstract (English)

Equivariant neural networks incorporate symmetries through group actions, embedding them as an inductive bias to improve performance. Existing methods learn an equivariant action on the latent space, or design architectures that are equivariant by construction. These approaches often deliver strong empirical results but can involve architecture-specific constraints, large parameter counts, and high computational cost. We challenge the paradigm of complex equivariant architectures with a parameter-free approach grounded in group representation theory. We prove that for an equivariant encoder over a finite group, the latent space must almost surely contain one copy of its regular representation for each linearly independent data orbit, which we explore with a number of empirical studies. Leveraging this foundational algebraic insight, we impose the group's regular representation as an inductive bias via an auxiliary loss, adding no learnable parameters. Our extensive evaluation shows that this method matches or outperforms specialized models in several cases, even those for infinite groups. We further validate our choice of the regular representation through an ablation study, showing it consistently outperforms defining and trivial group representation baselines.

等变网络群表示代数先验零参数

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。