arXiv:2507.02442cs.AImath.CT2025-07

用范畴论重新解释监督学习中的残差与参数关系,提升AI可解释性。

The Gauss-Markov Adjunction Provides Categorical Semantics of Residuals in Supervised Learning

  • 通过范畴论构建参数与数据的对偶结构,定义高斯-马尔可夫伴随关系。
  • 残差最小化与参数估计的最优解可通过右伴随函子保持极限来关联。
  • 为机器学习提供形式化语义基础,适合关注AI可解释性的研究者。

提升机器学习的可理解性与可解释性是响应可解释性作为人工智能原则的重要任务,也是推动人工智能更好社会应用的关键。本文旨在通过范畴论视角重构机器学习模型,建立结构化、可理解的人工智能系统语义框架。我们的范畴建模清晰地形式化了监督学习中残差与参数之间的结构性交互。论文聚焦于多元线性回归这一最基础的监督学习模型,定义了两个Lawvere增强范畴(分别对应参数与数据),并引入它们之间的伴随函子对,从而提出监督学习的范畴化表述。我们证明该框架的核心结构由所谓的‘高斯-马尔可夫伴随’捕捉。在此设定下,参数变化与残差之间的双向信息流动得以显式描述。普通最小二乘估计量与最小残差之间通过右伴随函子保持极限而相关联。此外,我们将这一表述定位为监督学习的扩展指称语义实例,并提议将理论计算机科学中的语义方法作为人工智能可解释性的形式基础。

原文摘要 · Abstract (English)

Enhancing the intelligibility and interpretability of machine learning is a crucial task in responding to the demand for Explicability as an AI principle, and in promoting the better social implementation of AI. The aim of our research is to contribute to this improvement by reformulating machine learning models through the lens of category theory, thereby developing a semantic framework for structuring and understanding AI systems. Our categorical modeling in this paper clarifies and formalizes the structural interplay between residuals and parameters in supervised learning. The present paper focuses on the multiple linear regression model, which represents the most basic form of supervised learning. By defining two Lawvere-enriched categories corresponding to parameters and data, along with an adjoint pair of functors between them, we introduce our categorical formulation of supervised learning. We show that the essential structure of this framework is captured by what we call the Gauss-Markov Adjunction. Within this setting, the dual flow of information can be explicitly described as a correspondence between variations in parameters and residuals. The ordinary least squares estimator for the parameters and the minimum residual are related via the preservation of limits by the right adjoint functor. Furthermore, we position this formulation as an instance of extended denotational semantics for supervised learning, and propose applying a semantic perspective developed in theoretical computer science as a formal foundation for Explicability in AI.

范畴论可解释性监督学习语义建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。