用神经网络构建可解释的模糊性建模工具,打通概率理论与机器学习的桥梁。
Neural Expectation Operators
- 将神经网络嵌入随机微分方程,实现非线性期望的可计算建模
- 证明了带局部利普希茨和二次增长条件的方程解存在且唯一
- 适用于含ReLU等常见结构的网络,适合处理不确定数据的建模任务
本文提出「度量学习」范式,通过参数化神经网络的驱动项来建模非线性期望,以应对不确定性。我们定义了神经期望算子为满足特定条件的后向随机微分方程(BSDE)的解,其驱动项在状态变量 $y$ 上满足局部利普希茨条件,在鞅分量 $z$ 上具有二次增长。该结果突破了传统全局利普希茨假设的限制,适用于常见神经网络架构(如带ReLU激活函数),并适用于指数可积的终端数据——这是该设定下的最优条件。核心创新在于建立深层随机理论与机器学习之间的可构造桥梁,证明这些抽象条件可通过具体、可验证的网络设计实现。我们提供了通过网络结构设计强制凸性等公理性质的方法。理论进一步扩展至全耦合前向-后向随机微分方程系统,以及大规模相互作用粒子系统的渐近分析,建立了大数定律(混沌传播)与中心极限定理。本工作为数据驱动的模糊性建模奠定了数学基础。
原文摘要 · Abstract (English)
This paper introduces \textbf{Measure Learning}, a paradigm for modeling ambiguity via non-linear expectations. We define Neural Expectation Operators as solutions to Backward Stochastic Differential Equations (BSDEs) whose drivers are parameterized by neural networks. The main mathematical contribution is a rigorous well-posedness theorem for BSDEs whose drivers satisfy a local Lipschitz condition in the state variable $y$ and quadratic growth in its martingale component $z$. This result circumvents the classical global Lipschitz assumption, is applicable to common neural network architectures (e.g., with ReLU activations), and holds for exponentially integrable terminal data, which is the sharp condition for this setting. Our primary innovation is to build a constructive bridge between the abstract, and often restrictive, assumptions of the deep theory of quadratic BSDEs and the world of machine learning, demonstrating that these conditions can be met by concrete, verifiable neural network designs. We provide constructive methods for enforcing key axiomatic properties, such as convexity, by architectural design. The theory is extended to the analysis of fully coupled Forward-Backward SDE systems and to the asymptotic analysis of large interacting particle systems, for which we establish both a Law of Large Numbers (propagation of chaos) and a Central Limit Theorem. This work provides the foundational mathematical framework for data-driven modeling under ambiguity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。