arXiv:2501.18972cs.LGcs.NA2025-01被引 17

用块因果注意力建模流体动力学,预测更准且泛化更强。

BCAT: A Block Causal Transformer for PDE Foundation Models for Fluid Dynamics

  • 采用块因果变换器,利用帧间上下文预测下一帧。
  • 平均相对误差仅1.18%,比之前方法提升40%以上。
  • 适合需要高精度流体模拟的科研与工程场景。

我们提出BCAT,一种用于二维流体动力学问题自回归求解的偏微分方程基础模型。该方法采用块因果变换器架构,通过前序帧作为上下文先验来预测下一帧,而非依赖图像生成中常见的子帧或像素级输入。这种块因果框架更有效捕捉非线性时空动态和物理现象中的空间依赖关系。消融实验显示,下一帧预测相比下一标记预测准确率提升3.5倍。BCAT在包含不可压缩与可压缩纳维-斯托克斯方程、不同几何形状与参数范围以及浅水方程的多样化流体动力学数据集上训练。模型在6项下游预测任务上评估,测试约8,000条轨迹以衡量鲁棒性。整体平均相对误差为1.18%,优于现有基准方法。在湍流数据集上微调后,新设置下的准确率较先前方法提升超40%。

原文摘要 · Abstract (English)

We introduce BCAT, a PDE foundation model designed for autoregressive prediction of solutions to two dimensional fluid dynamics problems. Our approach uses a block causal transformer architecture to model next frame predictions, leveraging previous frames as contextual priors rather than relying solely on sub-frames or pixel-based inputs commonly used in image generation methods. This block causal framework more effectively captures the spatial dependencies inherent in nonlinear spatiotemporal dynamics and physical phenomena. In an ablation study, next frame prediction demonstrated a 3.5x accuracy improvement over next token prediction. BCAT is trained on a diverse range of fluid dynamics datasets, including incompressible and compressible Navier-Stokes equations across various geometries and parameter regimes, as well as the shallow-water equations. The model's performance was evaluated on 6 distinct downstream prediction tasks and tested on about 8K trajectories to measure robustness on a variety of fluid dynamics simulations. BCAT achieved an average relative error of 1.18% across all evaluation tasks, outperforming prior approaches on standard benchmarks. With fine-tuning on a turbulence dataset, we show that the method adapts to new settings with more than 40% better accuracy over prior methods.

流体模拟因果变换器PDE模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。