arXiv:2507.01313cs.LGcs.AI2025-07

用神经算子求解高维随机控制问题,突破维度诅咒

Neural Hamiltonian Operator

  • 构建神经哈密顿算子,通过神经网络拟合控制与价值函数梯度
  • 训练网络满足庞特里亚金原理的相容性条件,实现最优控制求解
  • 理论证明通用逼近能力,适合研究高维控制与强化学习者

高维随机控制问题因维度诅咒难以求解。传统动态规划之外,庞特里亚金最大值原理(PMP)可将其转化为前向-后向随机微分方程(FBSDEs)系统。本文提出神经哈密顿算子(NHO),以神经网络参数化耦合的FBSDE动力学,分别表示反馈控制和价值函数的空间梯度。通过训练网络满足PMP所规定的相容性条件,可获得最优NHO。该算子理论视角将深度FBSDE方法置于统计推断框架下,视为从模拟数据中学习未知算子的问题。此视角使我们能在一般鞅驱动条件下证明NHO的通用逼近能力,并为该类模型固有的优化挑战提供清晰分析框架。

原文摘要 · Abstract (English)

Stochastic control problems in high dimensions are notoriously difficult to solve due to the curse of dimensionality. An alternative to traditional dynamic programming is Pontryagin's Maximum Principle (PMP), which recasts the problem as a system of Forward-Backward Stochastic Differential Equations (FBSDEs). In this paper, we introduce a formal framework for solving such problems with deep learning by defining a \textbf{Neural Hamiltonian Operator (NHO)}. This operator parameterizes the coupled FBSDE dynamics via neural networks that represent the feedback control and an ansatz for the value function's spatial gradient. We show how the optimal NHO can be found by training the underlying networks to enforce the consistency conditions dictated by the PMP. By adopting this operator-theoretic view, we situate the deep FBSDE method within the rigorous language of statistical inference, framing it as a problem of learning an unknown operator from simulated data. This perspective allows us to prove the universal approximation capabilities of NHOs under general martingale drivers and provides a clear lens for analyzing the significant optimization challenges inherent to this class of models.

随机控制神经算子深度学习优化挑战

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。