用随机傅里叶特征加正则化,高效学习带噪声的微分方程算子
Regularized Random Fourier Features and Finite Element Reconstruction for Operator Learning in Sobolev Space
- 从学生t分布采样随机特征,结合频率加权Tikhonov正则化抑制噪声
- 当特征数N≈m log m时,系统条件数良好,保证估计与泛化性能
- 对流、纳维-斯托克斯等多类偏微分方程均表现稳健,训练更快
算子学习是通过数据驱动方式近似无限维函数空间间的映射,如偏微分方程的解算子。基于核的方法可提供准确且理论支持的近似,但对大规模训练集计算开销大且易受噪声影响。本文提出正则化随机傅里叶特征(RRFF)方法,结合有限元重构映射(RRFF-FEM),用于从噪声数据中学习算子。该方法采用多元学生t分布生成随机特征,并引入频率加权Tikhonov正则化以抑制高频噪声。我们建立了相关随机特征矩阵极值奇异值的高概率界,证明当特征数N与训练样本数m满足N ≈ m log m时,系统具有良好条件性,从而获得估计与泛化保证。在包含对流、Burgers'方程、达西流、赫姆霍兹、纳维-斯托克斯及结构力学等基准偏微分方程问题上的详细数值实验表明,相较于未正则化随机特征模型,RRFF与RRFF-FEM在保持与核方法和神经算子相当精度的同时,显著提升抗噪能力并减少训练时间。
原文摘要 · Abstract (English)
Operator learning is a data-driven approximation of mappings between infinite-dimensional function spaces, such as the solution operators of partial differential equations. Kernel-based operator learning can offer accurate, theoretically justified approximations that require less training than standard methods. However, they can become computationally prohibitive for large training sets and can be sensitive to noise. We propose a regularized random Fourier feature (RRFF) approach, coupled with a finite element reconstruction map (RRFF-FEM), for learning operators from noisy data. The method uses random features drawn from multivariate Student's $t$ distributions, together with frequency-weighted Tikhonov regularization that suppresses high-frequency noise. We establish high-probability bounds on the extreme singular values of the associated random feature matrix and show that when the number of features $N$ scales like $m \log m$ with the number of training samples $m$, the system is well-conditioned, which yields estimation and generalization guarantees. Detailed numerical experiments on benchmark PDE problems, including advection, Burgers', Darcy flow, Helmholtz, Navier-Stokes, and structural mechanics, demonstrate that RRFF and RRFF-FEM are robust to noise and achieve improved performance with reduced training time compared to the unregularized random feature model, while maintaining competitive accuracy relative to kernel and neural operator tests.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。