arXiv:2603.19317cs.LGcs.AI2026-03

用代数结构解释神经网络为何能泛化,发现其学习的是天然数学结构。

Ternary Gamma Semirings: From Neural Implementation to Categorical Foundations

  • 引入三元伽马半环逻辑约束,使网络在组合任务上从0%提升至100%准确率。
  • 学习到的特征空间构成有限交换三元Γ-半环,其三元运算实现多数表决规则。
  • 揭示神经网络泛化本质:内化对称性、幂等性和多数性等代数公理。

本文建立神经网络学习与抽象代数结构之间的理论框架。首先提出一个最小反例,证明标准神经网络在组合泛化任务中完全失败(准确率为0%)。通过引入逻辑约束——三元伽马半环,相同架构可学习到完全结构化的特征空间,对新组合实现100%准确率。我们证明该学习到的特征空间构成一个有限交换三元$Γ$-半环,其三元运算实现多数表决规则。对比近期Gokavarapu等人的工作,该结构恰好对应于$|T|=4$、$|Γ|=1$的布尔型三元$Γ$-半环,且在其枚举中唯一(同构意义下)。研究揭示三大结论:(i) 神经网络的成功可理解为对数学‘自然’结构的近似;(ii) 学习表征的泛化源于其内化了代数公理(对称性、幂等性、多数性);(iii) 逻辑约束引导网络收敛至这些典范形式。本工作为理解神经网络泛化提供严谨数学框架,并开启计算Γ-代数这一跨学科新方向。

原文摘要 · Abstract (English)

This paper establishes a theoretical framework connecting neural network learning with abstract algebraic structures. We first present a minimal counterexample demonstrating that standard neural networks completely fail on compositional generalization tasks (0% accuracy). By introducing a logical constraint -- the Ternary Gamma Semiring -- the same architecture learns a perfectly structured feature space, achieving 100% accuracy on novel combinations. We prove that this learned feature space constitutes a finite commutative ternary $Γ$-semiring, whose ternary operation implements the majority vote rule. Comparing with the recently established classification of Gokavarapu et al., we show that this structure corresponds precisely to the Boolean-type ternary $Γ$-semiring with $|T|=4$, $|Γ|=1$}, which is unique up to isomorphism in their enumeration. Our findings reveal three profound conclusions: (i) the success of neural networks can be understood as an approximation of mathematically ``natural'' structures; (ii) learned representations generalize because they internalize algebraic axioms (symmetry, idempotence, majority property); (iii) logical constraints guide networks to converge to these canonical forms. This work provides a rigorous mathematical framework for understanding neural network generalization and inaugurates the new interdisciplinary direction of Computational $Γ$-Algebra.

神经网络代数结构泛化能力计算代数

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。