arXiv:2505.17341cs.LG2025-05被引 19

用可学习的时间积分提升神经算子的长期预测稳定性

TI-DeepONet: Learnable Time Integration for Stable Long-Term Extrapolation

  • 将预测目标从状态改为瞬时导数,再用数值积分求解
  • 长期外推误差比自回归方法降低96.3%,是固定时域方法的16.4%
  • 支持高阶积分器,适合需要长时间稳定模拟的物理系统

准确的时序外推仍是神经算子建模动力系统的核心挑战,需将预测延伸至训练范围之外。传统DeepONet方法依赖两种局限范式:固定时域滚动预测忽略时间因果性,自回归方案则通过逐步预测累积误差。本文提出TI-DeepONet框架,将神经算子与自适应数值时间步长结合,保持动力系统的马尔可夫结构并抑制长期误差增长。方法将学习目标从直接状态预测转为近似瞬时时间导数场,再由标准数值求解器积分,实现连续时间预测,并允许推理时使用高于训练阶段的高阶积分器,提升效率与精度。进一步提出TI(L)-DeepONet,引入多阶段积分中可学习系数,适配特定解的动力学特性,增强保真度。在六类典型偏微分方程(涵盖混沌、耗散、色散及高维行为)上,TI(L)-DeepONet略优于TI-DeepONet,两者相对L2外推误差均较自回归方法降低约96.3%,较固定时域方法降低83.6%。值得注意的是,两类模型在接近两倍训练区间的时间域上仍保持稳定预测。该工作建立了一个融合神经逼近与数值分析原理的物理感知算子学习框架,填补了复杂物理系统长期预报的关键空白。

原文摘要 · Abstract (English)

Accurate temporal extrapolation remains a fundamental challenge for neural operators modeling dynamical systems, where predictions must extend far beyond the training horizon. Conventional DeepONet approaches rely on two limited paradigms: fixed-horizon rollouts, which predict full spatiotemporal solutions while ignoring temporal causality, and autoregressive schemes, which accumulate errors through sequential prediction. We introduce TI-DeepONet, a framework that integrates neural operators with adaptive numerical time-stepping to preserve the Markovian structure of dynamical systems while mitigating long-term error growth. Our method shifts the learning objective from direct state prediction to approximating instantaneous time-derivative fields, which are then integrated using standard numerical solvers. This naturally enables continuous-time prediction and allows the use of higher-order integrators at inference than those used in training, improving both efficiency and accuracy. We further propose TI(L)-DeepONet, which incorporates learnable coefficients for intermediate stages in multi-stage integration, adapting to solution-specific dynamics and enhancing fidelity. Across six canonical PDEs featuring chaotic, dissipative, dispersive, and high-dimensional behavior, TI(L)-DeepONet maeginally outperforms TI-DeepONet, and both achieve major reductions in relative L2 extrapolation error: about 96.3% compared to autoregressive methods and 83.6% compared to fixed-horizon approaches. Notably, both models maintain stable predictions over temporal domains nearly twice the training interval. This work establishes a physics-aware operator learning framework that bridges neural approximation with numerical analysis principles, addressing a key gap in long-term forecasting of complex physical systems.

神经算子时间积分长期预测偏微分方程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。