用递归训练提升神经算子长期预测稳定性
Recurrent Neural Operators: Stable Long-Term PDE Prediction
- 训练时让模型自己预测后续步骤,模拟真实推理过程
- 长期预测误差从指数增长变为线性增长,提升稳定性
- 适合需要长时间模拟的物理系统建模任务
神经算子已成为学习偏微分方程解算子的强大工具。然而,在时变问题中,标准训练策略(如教师强制)在训练与推理之间引入不匹配,导致自回归长期预测中的误差累积。为此,我们提出递归神经算子(RNOs)——一种将递归训练融入神经算子架构的新框架。RNOs 不依赖真值输入进行每一步训练,而是将算子递归应用于自身预测的时间窗口内,有效在训练中模拟推理时的动力学。这种对齐缓解了暴露偏差,增强了对误差累积的鲁棒性。理论上,我们证明递归训练可将教师强制下典型的最坏情况指数误差增长降至线性增长。实证上,我们展示了递归训练的多网格神经算子在标准基准测试中显著优于教师强制版本,在长期精度和稳定性方面表现更优。结果强调了在神经算子学习中,训练与推理动态对鲁棒时间泛化的关键作用。
原文摘要 · Abstract (English)
Neural operators have emerged as powerful tools for learning solution operators of partial differential equations. However, in time-dependent problems, standard training strategies such as teacher forcing introduce a mismatch between training and inference, leading to compounding errors in long-term autoregressive predictions. To address this issue, we propose Recurrent Neural Operators (RNOs)-a novel framework that integrates recurrent training into neural operator architectures. Instead of conditioning each training step on ground-truth inputs, RNOs recursively apply the operator to their own predictions over a temporal window, effectively simulating inference-time dynamics during training. This alignment mitigates exposure bias and enhances robustness to error accumulation. Theoretically, we show that recurrent training can reduce the worst-case exponential error growth typical of teacher forcing to linear growth. Empirically, we demonstrate that recurrently trained Multigrid Neural Operators significantly outperform their teacher-forced counterparts in long-term accuracy and stability on standard benchmarks. Our results underscore the importance of aligning training with inference dynamics for robust temporal generalization in neural operator learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。