给出条件期望算子有界性的可验证判据,打通了机器学习与概率论的桥梁。
Verifiable Regularity Criterion for Conditional Expectation Operators and Conditional Mean Embeddings with Applications to Nonparametric Regression, Bayesian Inverse Problems, and Koopman Operators
- 通过条件密度的光滑性判断算子映射性质,方法简洁可验证
- 在三个场景中证明经典正则性假设足以保证算子有界
- 适合研究核方法、贝叶斯反问题和动力系统建模的研究者
条件期望算子(CEO)及其条件均值嵌入(CME)在非参数回归、贝叶斯反问题和随机动力系统的科普曼算子理论中具有核心作用。本文揭示了CEO将定义在$\mathcal{Y}$上的函数空间映射到$\mathcal{X}$上指定函数空间(特别是再生核希尔伯特空间RKHS)的关键条件:该条件由条件分布的Radon--Nikodym密度的正则性决定,并给出了一个简单可验证的充分条件,确保CEO有界且为希尔伯特-施密特算子。当RKHS与Sobolev空间范数等价时,该条件退化为条件密度的Sobolev正则性。这一结果直接用于验证CME表示的有效性及伽辽金型和基于CME的估计器的误差界。我们在非参数回归、贝叶斯反问题以及随机动力系统的科普曼算子理论三种情形下验证了该正则性条件,证明经典概率模型的正则性假设即蕴含所需的算子映射性质。该框架为概率、算子理论、核方法与随机动力学中的条件期望算子提供了统一视角。
原文摘要 · Abstract (English)
Conditional expectation operators (CEOs) and their associated conditional mean embeddings (CMEs) play a central role across applied mathematics and machine learning, appearing in nonparametric regression, Bayesian inverse problems, and Koopman operator theory. A fundamental question is when a CEO maps a function space on $\mathcal{Y}$ into a prescribed function space on $\mathcal{X}$, particularly a reproducing kernel Hilbert space (RKHS). We show that such mapping properties are characterized by the regularity of the Radon--Nikodym density of the conditional law, and establish a simple, verifiable sufficient condition under which the CEO is bounded and Hilbert--Schmidt. For RKHSs norm-equivalent to Sobolev spaces, this condition reduces to Sobolev regularity of the conditional density. The result yields a direct route to validate CME representations and error bounds for Galerkin-type and CME-based estimators. We verify the regularity condition in three settings: nonparametric regression, Bayesian inverse problems, and Koopman operator theory for stochastic dynamical systems. We show in each case that classical regularity results on the underlying probabilistic model imply the required mapping properties. The resulting framework offers a unified perspective on conditional expectation operators across probability, operator theory, kernel methods, and stochastic dynamics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。