arXiv:2604.06475cs.LGcs.NA2026-04被引 1

用多阶段参数注入提升长时序PDE建模精度,兼顾效率与保真度。

AE-ViT: Stable Long-Horizon Parametric Partial Differential Equations Modeling

  • 通过卷积编码器+注意力机制在潜空间演化,结合坐标通道增强空间感知
  • 在多个场联合预测中将相对滚动误差降低约5倍,优于现有方法
  • 适合需要高精度多场模拟的科学计算场景,如流体、反应扩散系统

深度学习降维模型(DL-ROM)因其处理高维数据、逼近非线性映射和利用GPU的能力,正成为参数化偏微分方程(PDE)的流行代理模型。现有方法通常在全解场或自编码器压缩的潜空间中学习演化:前者计算成本高,后者潜变量难以演化。此外,参数化PDE中初始条件不足以确定轨迹,多数方法未评估对多组分、不同量级与参数敏感性解的联合预测能力。为此,我们提出一种联合模型,包含卷积编码器、在潜空间运行的Transformer和解码器,核心创新为多阶段参数注入与坐标通道注入。参数在多阶段注入以改善条件,物理坐标编码提供空间信息,使模型能动态适应不同控制参数。在对流-扩散-反应方程和圆柱尾流纳维-斯托克斯流动的实验中,该方法结合潜空间演化的效率与全场模型的保真度,在多场预测上显著优于DL-ROM、潜空间Transformer和普通ViT,相对滚动误差降低约5倍。

原文摘要 · Abstract (English)

Deep Learning Reduced Order Models (ROMs) are becoming increasingly popular as surrogate models for parametric partial differential equations (PDEs) due to their ability to handle high-dimensional data, approximate highly nonlinear mappings, and utilize GPUs. Existing approaches typically learn evolution either on the full solution field, which requires capturing long-range spatial interactions at high computational cost, or on compressed latent representations obtained from autoencoders, which reduces the cost but often yields latent vectors that are difficult to evolve, since they primarily encode spatial information. Moreover, in parametric PDEs, the initial condition alone is not sufficient to determine the trajectory, and most current approaches are not evaluated on jointly predicting multiple solution components with differing magnitudes and parameter sensitivities. To address these challenges, we propose a joint model consisting of a convolutional encoder, a transformer operating on latent representations, and a decoder for reconstruction. The main novelties are joint training with multi-stage parameter injection and coordinate channel injection. Parameters are injected at multiple stages to improve conditioning. Physical coordinates are encoded to provide spatial information. This allows the model to dynamically adapt its computations to the specific PDE parameters governing each system, rather than learning a single fixed response. Experiments on the Advection-Diffusion-Reaction equation and Navier-Stokes flow around the cylinder wake demonstrate that our approach combines the efficiency of latent evolution with the fidelity of full-field models, outperforming DL-ROMs, latent transformers, and plain ViTs in multi-field prediction, reducing the relative rollout error by approximately $5$ times.

PDE建模降维模型Transformer科学计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。