arXiv:2511.19980cs.LGcs.NA2025-11被引 5

用神经网络逼近微分方程解,达到机器精度。

Operator Learning at Machine Precision

  • 不直接拟合解算子,而是学习牛顿-坎托罗维奇迭代中的椭圆算子的Cholesky分解。
  • 在多个非线性微分方程问题上实现机器精度,误差低于1e-12。
  • 可推广至未见过的方程,适合科学计算与高精度仿真场景。

神经算子学习方法在科学计算中备受关注,因其能近似无穷维算子。然而,增加复杂度常无法显著提升精度,仍与核方法和传统降阶模型相当。本文提出CHONKNORIS(Cholesky Newton–Kantorovich Neural Operator Residual Iterative System),一种可实现机器精度的算子学习范式。该方法借鉴数值分析:许多非线性前向与反演偏微分方程可通过牛顿型方法求解。与其回归解算子本身,我们回归与Tikhonov正则化牛顿–坎托罗维奇更新相关的椭圆算子的Cholesky因子。由此生成的展开迭代架构,其机器精度行为源于收缩映射性质,对中间精度要求远低于端到端拟合解算子。我们在多种非线性前向与反演问题上测试了CHONKNORIS,包括非线性椭圆方程、Burgers方程、非线性达西流、Calderón问题、反波散射问题及地震成像问题。我们还给出了关于模拟Cholesky因子精度的收敛性理论保证。此外,我们引入基础模型变体FONKNORIS(Foundation Newton–Kantorovich Neural Operator Residual Iterative System),聚合多个预训练的CHONKNORIS专家以模拟新非线性PDE的解映射。FONKNORIS模型能准确求解如Klein–Gordon和Sine–Gordon等未见方程。

原文摘要 · Abstract (English)

Neural operator learning methods have garnered significant attention in scientific computing for their ability to approximate infinite-dimensional operators. However, increasing their complexity often fails to substantially improve their accuracy, leaving them on par with much simpler approaches such as kernel methods and more traditional reduced-order models. In this article, we set out to address this shortcoming and introduce CHONKNORIS (Cholesky Newton--Kantorovich Neural Operator Residual Iterative System), an operator learning paradigm that can achieve machine precision. CHONKNORIS draws on numerical analysis: many nonlinear forward and inverse PDE problems are solvable by Newton-type methods. Rather than regressing the solution operator itself, our method regresses the Cholesky factors of the elliptic operator associated with Tikhonov-regularized Newton--Kantorovich updates. The resulting unrolled iteration yields a neural architecture whose machine-precision behavior follows from achieving a contractive map, requiring far lower accuracy than end-to-end approximation of the solution operator. We benchmark CHONKNORIS on a range of nonlinear forward and inverse problems, including a nonlinear elliptic equation, Burgers' equation, a nonlinear Darcy flow problem, the Calderón problem, an inverse wave scattering problem, and a problem from seismic imaging. We also present theoretical guarantees for the convergence of CHONKNORIS in terms of the accuracy of the emulated Cholesky factors. Additionally, we introduce a foundation model variant, FONKNORIS (Foundation Newton--Kantorovich Neural Operator Residual Iterative System), which aggregates multiple pre-trained CHONKNORIS experts for diverse PDEs to emulate the solution map of a novel nonlinear PDE. Our FONKNORIS model is able to accurately solve unseen nonlinear PDEs such as the Klein--Gordon and Sine--Gordon equations.

神经算子微分方程机器精度科学计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。