arXiv:2506.20764math.OCcs.LG2025-06

把神经网络看作偏微分方程,优化其系数以提升学习效果。

Control and optimization for Neural Partial Differential Equations in Supervised Learning

  • 将神经网络建模为拟线性抛物/双曲型偏微分方程,从控制理论视角优化其系数。
  • 证明了抛物型方程控制问题存在最小解,且可构建双重系统求解框架。
  • 为神经网络的数学建模提供新思路,适合研究深度学习与控制理论交叉者。

尽管关于抛物型和双曲型系统的控制与优化问题已有大量研究,但对相关算子系数的控制与优化问题尚未深入探索。本文旨在开启一条新研究方向:在监督学习背景下,将神经网络视为偏微分方程(PDE),从而将传统常微分方程(ODE)中的控制问题重新表述为对抛物型和双曲型算子系数的控制与优化问题。在监督学习中,目标是通过网络层将初始数据传输至目标数据。为此,我们提出抛物型PDE控制与优化问题的双重系统形式,为未来高效数值方法奠定基础,并证明该问题存在最小解。此外,我们研究了双曲型PDE的控制问题,证明了对应近似控制问题解的存在性。

原文摘要 · Abstract (English)

Although there is a substantial body of literature on control and optimization problems for parabolic and hyperbolic systems, the specific problem of controlling and optimizing the coefficients of the associated operators within such systems has not yet been thoroughly explored. In this work, we aim to initiate a line of research in control theory focused on optimizing and controlling the coefficients of these operators-a problem that naturally arises in the context of neural networks and supervised learning. In supervised learning, the primary objective is to transport initial data toward target data through the layers of a neural network. We propose a novel perspective: neural networks can be interpreted as partial differential equations (PDEs). From this viewpoint, the control problem traditionally studied in the context of ordinary differential equations (ODEs) is reformulated as a control problem for PDEs, specifically targeting the optimization and control of coefficients in parabolic and hyperbolic operators. To the best of our knowledge, this specific problem has not yet been systematically addressed in the control theory of PDEs. To this end, we propose a dual system formulation for the control and optimization problem associated with parabolic PDEs, laying the groundwork for the development of efficient numerical schemes in future research. We also provide a theoretical proof showing that the control and optimization problem for parabolic PDEs admits minimizers. Finally, we investigate the control problem associated with hyperbolic PDEs and prove the existence of solutions for a corresponding approximated control problem.

神经网络偏微分方程控制理论优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。