提出新模型提升微分方程预测在未知参数下的泛化能力。
Late Fusion Neural Operators for Extrapolation Across Parameter Space in Partial Differential Equations

- 分离状态与参数学习,避免信息混淆。
- 跨参数域平均误差降低71.8%,优于现有方法。
- 适合需要强外推能力的科学计算场景。
开发能准确预测偏微分方程(PDE)系统在未见参数区间行为的神经算子,对科学与工程应用中的鲁棒泛化至关重要。实际中物理参数变化导致训练与预测分布偏移,外推成为核心挑战。参数融入神经算子的方式直接影响泛化能力,尤其当状态与参数表示纠缠时。本文提出晚期融合神经算子,将状态动态学习与参数影响解耦,提升域内与域外预测性能。方法结合神经算子学习隐状态表示,用稀疏回归结构化引入参数信息。在包括对流、Burgers方程及一维、二维反应-扩散方程在内的四个基准测试中,该方法持续优于傅里叶神经算子和CAPE-FNO。在所有实验中表现最佳,域内平均RMSE降低72.9%,域外降低71.8%。结果表明模型在域内与域外参数区间均具备强泛化能力。
原文摘要 · Abstract (English)
Developing neural operators that accurately predict the behavior of systems governed by partial differential equations (PDEs) across unseen parameter regimes is crucial for robust generalization in scientific and engineering applications. In practical applications, variations in physical parameters induce distribution shifts between training and prediction regimes, making extrapolation a central challenge. As a result, the way parameters are incorporated into neural operator models plays a key role in their ability to generalize, particularly when state and parameter representations are entangled. In this work, we introduce the Late Fusion Neural Operator, an architecture that disentangles learning state dynamics from parameter effects, improving predictive performance both within and beyond the training distribution. Our approach combines neural operators for learning latent state representations with sparse regression to incorporate parameter information in a structured manner. Across four benchmark PDEs including advection, Burgers, and both 1D and 2D reaction-diffusion equations, the proposed method consistently outperforms Fourier Neural Operator and CAPE-FNO. Late Fusion Neural Operators achieve consistently the best performance in all experiments, with an average RMSE reduction of 72.9% in-domain and 71.8% out-domain compared to the second-best method. These results demonstrate strong generalization across both in-domain and out-domain parameter regimes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。