通过分阶段提升小模型,让神经微分方程代理更高效精准。
Operator Boosting Produces Pareto-Efficient PDE Surrogates

- 用逐步修正残差的方式构建小型神经算子,跳过大模型压缩步骤。
- 在30个基准上21个准确率提升,参数量减少72%-95%。
- 适合需要高精度与低资源平衡的科学计算场景。
神经算子广泛用于偏微分方程(PDE)的代理求解,但全尺寸模型在多查询科学工作流中存储、部署和评估成本高昂。本文提出算子提升(Operator Boosting),一种直接构建紧凑神经算子代理的分阶段残差学习框架,而非先训练大模型再压缩。从归一化输出空间的均值预测器出发,该方法在残差场上传统同族的小型神经算子,并通过验证选择的缩放系数逐个融合。我们在傅里叶神经算子(FNO)、DeepONet和卷积神经算子(CNO)上实现该框架,对比了多个来自PDEBench、APEBench和The Well的一维、二维、三维PDE基准。在30个数据集-架构组合中,21个显示平均精度提升,17个置信区间为正,所有增强堆栈的可训练参数量减少约72%-95%。最佳模型比较显示,在10个完成的基准中有7个实现了经验帕累托改进,包括二维纳维-斯托克斯方程、浅水动力学、达西流、一维输运与反应系统以及三维可压缩纳维-斯托克斯方程。结果表明,算子提升通常能改善神经PDE代理的精度-参数帕累托前沿,同时揭示了特定PDE和架构下残差提升无法抵消压缩损失的失效区域。
原文摘要 · Abstract (English)
Neural operators are widely used as surrogate solution maps for partial differential equations (PDEs), but full-size models can be costly to store, deploy, and evaluate in many-query scientific workflows. This work introduces Operator Boosting, a stagewise residual-learning framework for constructing compact neural-operator surrogates directly, rather than training a large model and compressing it afterward. Starting from the empirical mean predictor in normalized output coordinates, the method trains a sequence of tiny same-family neural operators on residual fields and incorporates each correction through validation-selected shrinkage. We instantiate the framework with Fourier neural operators (FNOs), DeepONets, and convolutional neural operators (CNOs), and compare boosted tiny stacks against full-size monolithic baselines across one-, two-, and three-dimensional PDE benchmarks from PDEBench, APEBench, and The Well. Across 30 dataset-architecture pairs, 21 show positive mean accuracy gains and 17 have positive confidence intervals, while all boosted stacks reduce trainable parameter count by approximately 72-95%. Best-model comparisons show empirical Pareto improvements on 7 of 10 completed PDE benchmarks, including two-dimensional Navier-Stokes, shallow-water dynamics, Darcy flow, one-dimensional transport and reaction systems, and three-dimensional compressible Navier-Stokes. These results show that Operator Boosting often improves the empirical accuracy-parameter Pareto frontier of neural PDE surrogates, while also exposing PDE- and architecture-dependent regimes where residual boosting fails to offset compression.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。