用核方法学习无限维空间间的非线性算子,突破维度诅咒。
A Kernel-based Stochastic Approximation Framework for Nonlinear Operator Learning
- 基于广义核函数构建向量值再生核希尔伯特空间,支持复杂结构建模。
- 证明了无维度依赖的多项式收敛速率,可克服高维计算瓶颈。
- 适用于积分算子和编码器-解码器架构,适合需理论保障的建模任务。
我们提出一种基于核函数的随机逼近框架,用于学习无限维空间之间的非线性算子,采用通用的梅尔奇(Mercer)型算子值核。该框架涵盖两类关键核:(i) 可紧致的核,具有离散谱分解;(ii) 形如 $K(x,x')=k(x,x')T$ 的对角核,其中 $k$ 为标量核,$T$ 为输出空间上的正算子。这一广泛设定诱导出表达能力强的向量值再生核希尔伯特空间(RKHS),超越经典 $K=kI$ 模型,实现丰富结构建模并具备严格的理论保证。针对目标算子超出RKHS的情形,引入向量值插值空间以精确量化模型误设误差。在该框架下,我们建立无维度依赖的多项式收敛率,证明非线性算子学习可克服维度诅咒。使用一般算子值核进一步推导出内在非线性算子学习的收敛速率,突破 $K=kI$ 构造中的线性行为限制。该框架适用于多种算子学习任务,包括弗雷德霍姆型积分算子及基于编码器-解码器的结构。通过二维纳维-斯托克斯方程的数值实验验证了其有效性。
原文摘要 · Abstract (English)
We develop a stochastic approximation framework for learning nonlinear operators between infinite-dimensional spaces utilizing general Mercer operator-valued kernels. Our framework encompasses two key classes: (i) compact kernels, which admit discrete spectral decompositions, and (ii) diagonal kernels of the form $K(x,x')=k(x,x')T$, where $k$ is a scalar-valued kernel and $T$ is a positive operator on the output space. This broad setting induces expressive vector-valued reproducing kernel Hilbert spaces (RKHSs) that generalize the classical $K=kI$ paradigm, thereby enabling rich structural modeling with rigorous theoretical guarantees. To address target operators lying outside the RKHS, we introduce vector-valued interpolation spaces to precisely quantify misspecification error. Within this framework, we establish dimension-free polynomial convergence rates, demonstrating that nonlinear operator learning can overcome the curse of dimensionality. The use of general operator-valued kernels further allows us to derive rates for intrinsically nonlinear operator learning, going beyond the linear-type behavior inherent in diagonal constructions of $K=kI$. Importantly, this framework accommodates a wide range of operator learning tasks, ranging from integral operators such as Fredholm operators to architectures based on encoder-decoder representations. Moreover, we validate its effectiveness through numerical experiments on the two-dimensional Navier-Stokes equations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。