用物理启发的注意力机制,提升波动力学长期预测精度。
Predicting Wave Dynamics using Deep Learning with Multistep Integration Inspired Attention and Physics-Based Loss Decomposition
- 借鉴多步积分思想设计注意力网络,增强隐空间时间演化的稳定性。
- 分离相位与振幅损失,显著减少长期预测中的误差累积。
- 适合需要高精度实时模拟的流体波动力学场景。
本文提出一种基于物理的深度学习框架,用于数据驱动的流体介质中波传播预测。所提方法名为多步积分启发注意力(MI2A),结合去噪卷积自编码器进行低维隐表示,以及基于注意力的长短期记忆循环神经网络,实现隐坐标的时间演化。该架构受经典线性多步法启发,提升隐空间时间积分的稳定性和长期预测准确性。尽管混合神经架构在建模波动力学方面高效,但自回归预测常随时间积累相位和振幅误差。为缓解此问题,我们在MI2A框架中引入新型损失分解策略,将训练损失显式分为相位与振幅两个独立分量。我们对比了两种基准降阶模型:标准序列到序列循环神经网络和使用Luong注意力的变体。通过三个渐增复杂度的波传播基准问题验证:一维线性对流、非线性黏性Burgers方程及二维圣维南浅水系统。结果表明,MI2A框架显著提升长期预测的准确性和稳定性,精确保持波的振幅与相位特征。相比标准LSTM与注意力模型,基于MI2A的深度学习方法展现出更优泛化能力与时间精度,是实时波建模的有力工具。
原文摘要 · Abstract (English)
In this paper, we present a physics-based deep learning framework for data-driven prediction of wave propagation in fluid media. The proposed approach, termed Multistep Integration-Inspired Attention (MI2A), combines a denoising-based convolutional autoencoder for reduced latent representation with an attention-based recurrent neural network with long-short-term memory cells for time evolution of reduced coordinates. This proposed architecture draws inspiration from classical linear multistep methods to enhance stability and long-horizon accuracy in latent-time integration. Despite the efficiency of hybrid neural architectures in modeling wave dynamics, autoregressive predictions are often prone to accumulating phase and amplitude errors over time. To mitigate this issue within the MI2A framework, we introduce a novel loss decomposition strategy that explicitly separates the training loss function into distinct phase and amplitude components. We assess the performance of MI2A against two baseline reduced-order models trained with standard mean-squared error loss: a sequence-to-sequence recurrent neural network and a variant using Luong-style attention. To demonstrate the effectiveness of the MI2A model, we consider three benchmark wave propagation problems of increasing complexity, namely one-dimensional linear convection, the nonlinear viscous Burgers equation, and the two-dimensional Saint-Venant shallow water system. Our results demonstrate that the MI2A framework significantly improves the accuracy and stability of long-term predictions, accurately preserving wave amplitude and phase characteristics. Compared to the standard long-short term memory and attention-based models, MI2A-based deep learning exhibits superior generalization and temporal accuracy, making it a promising tool for real-time wave modeling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。