用多阶段神经算子加速卷积计算,精度接近机器精度。
Multi-stage neural operator learning with application for convolutions

- 分阶段迭代学习残差,逐步构建更精确的算子逼近空间。
- 在单精度下卷积计算精度接近机器精度,查询效率显著提升。
- 适用于输入密度和核函数变化的多输入场景,适合科学计算需求。
卷积积分广泛存在于各类应用中,为实现快速且精确的计算,本文提出两种通用的多阶段神经算子学习框架。第一种是深度配点神经算子(DCNO),一种监督方法,通过学习输入输出数据对的残差,迭代优化算子近似。第二种是深度伽辽金神经算子(DGNO),一种无监督框架,当目标算子可由偏微分方程(PDE)表示时,利用PDE弱形式残差进行训练。两者均通过多阶段训练逐步构建基算子,丰富逼近空间,显著提升标准单次学习的精度。我们提供了理论分析以验证其逼近能力,并将其应用于卷积学习。大量数值实验表明,DCNO与DGNO在卷积问题上均达到高精度,单精度下接近机器精度,并在大量查询或参数变化场景中相比传统求解器展现出显著效率优势。此外,该框架还扩展至处理输入密度与卷积核同时变化的多输入算子学习场景。
原文摘要 · Abstract (English)
Convolution integrals widely exist in applications, and to enable fast and accurate computations, this paper introduces two general multi-stage neural operator learning frameworks. The first, Deep Collocation Neural Operator (DCNO), is a supervised approach that iteratively refines the operator approximation by learning residuals from input-output data pairs. The second, Deep Galerkin Neural Operator (DGNO), is an unsupervised framework applicable when the target operator can be represented by a PDE, leveraging the weak form of the PDE residual for training. Both methods progressively construct basis operators through multiple training stages to enrich the approximation space, leading to significantly improved accuracy over standard one-shot operator learning. We provide theoretical analysis for their approximation capabilities and implement them for learning convolutions. Extensive numerical experiments demonstrate that both DCNO and DGNO achieve high accuracy, approaching machine precision under single float for convolution problems, and offer substantial efficiency gains for numerous queries or parametric variations compared to traditional solvers. We also extend these frameworks to handle multi-input operator learning scenarios involving variations in both the density and kernel of a convolution.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。