arXiv:2608.28446math.STcs.LG2026-08

将正则化最小二乘扩展到无限维,用广义样条和高斯过程统一求解反问题。

Generalized Splines and Gaussian Processes

  • 用广义样条替代线性回归,构建无限维最优估计框架。
  • 证明了分数样条与分数布朗运动间的最优估计对应关系。
  • 适用于贝叶斯方法、信号处理等领域的无限维反问题求解。

在变量为高斯分布的有限维线性反问题中,最小均方误差估计等价于正则化最小二乘拟合。本文将这一等价关系推广至更广泛的无限维情形:广义样条充当线性回归器,定义在核空间 $S$ 上的广义高斯过程则是高斯随机向量的对应物。该形式化类似于从经典函数到广义函数(分布)的转变。核心是引入一个白化/正则化算子 $L: S\to S'$,其连续延拓诱导出一个原生希尔伯特空间 $H\subset S'$,在刻画中起关键作用。全文自洽且高度一般化,可涵盖所有已知此类等价实例,包括Kailath及其学生提出的创新方法与再生核希尔伯特空间方法,以及分数样条与曼德尔布罗特分数布朗运动(分形)之间的数学对应关系——前者正是后者的最优估计器。同时,也适用于无限维反问题的广义贝叶斯方法。

原文摘要 · Abstract (English)

For finite-dimensional linear inverse problems where the variables are Gaussian, it is well-known that the minimum-mean-square error estimator takes the form of a regularized least-squares data fit. In this chapter, we show that this equivalence extends to a much broader infinite-dimensional setting where generalized splines take the role of linear regressors and generalized Gaussian processes on a nuclear space $S$ are the counterpart of Gaussian random vectors. The scope of this extension is of the same nature as the switch from the classic notion of function to that of a distribution, also known as a "generalized function." Our formalism involves a whitening/regularization operator $L: S\to S'$ whose continuous extension induces a native Hilbert space $H\subset S'$ that plays a central role in our characterization. The presentation is self-contained for the most part and remarkably general and powerful. It allows for the recovery of all known instances of such equivalences; in particular, the methods involving innovations and reproducing-kernel Hilbert spaces developed by Kailath and his students, and the mathematical correspondence between fractional splines and Mandelbrot's fractional Brownian motion (fractals), with the former being the optimal estimators of the latter. It also covers general Bayesian methods for the resolution of infinite-dimensional inverse problems.

反问题高斯过程样条贝叶斯推断

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。