arXiv:2410.01153cs.LG2024-10ICLR被引 29

用文本生成物理模拟,让神经微分方程求解更高效易用。

Text2PDE: Latent Diffusion Models for Accessible Physics Simulation

  • 用潜空间扩散模型与网格自编码器压缩物理数据,支持多场景仿真。
  • 实现时空联合生成,减少误差累积,精度媲美主流神经求解器。
  • 支持文本驱动生成,适合非专业用户快速构建物理模拟场景。

深度学习推动了数据驱动的偏微分方程(PDE)求解方法发展。这类神经PDE求解器通常比传统数值方法更快,但普遍存在训练成本高、精度与适用性难以兼顾的问题。本文提出将潜空间扩散模型应用于物理模拟,首先引入网格自编码器,压缩任意离散化PDE数据,实现跨物理场景的高效扩散训练;其次探索全时空联合生成,缓解自回归推理中的误差积累;最后研究基于初始物理量或纯文本提示的条件生成,验证语言作为紧凑、可解释且准确的生成模态的有效性。在均匀与结构化网格上的实验表明,该方法在精度与效率上均达到当前神经PDE求解器水平,且具备约30亿参数规模下的良好扩展性。本工作为可扩展、高精度、易用的物理模拟器奠定了基础,推动神经PDE求解迈向实际应用。

原文摘要 · Abstract (English)

Recent advances in deep learning have inspired numerous works on data-driven solutions to partial differential equation (PDE) problems. These neural PDE solvers can often be much faster than their numerical counterparts; however, each presents its unique limitations and generally balances training cost, numerical accuracy, and ease of applicability to different problem setups. To address these limitations, we introduce several methods to apply latent diffusion models to physics simulation. Firstly, we introduce a mesh autoencoder to compress arbitrarily discretized PDE data, allowing for efficient diffusion training across various physics. Furthermore, we investigate full spatio-temporal solution generation to mitigate autoregressive error accumulation. Lastly, we investigate conditioning on initial physical quantities, as well as conditioning solely on a text prompt to introduce text2PDE generation. We show that language can be a compact, interpretable, and accurate modality for generating physics simulations, paving the way for more usable and accessible PDE solvers. Through experiments on both uniform and structured grids, we show that the proposed approach is competitive with current neural PDE solvers in both accuracy and efficiency, with promising scaling behavior up to $\sim$3 billion parameters. By introducing a scalable, accurate, and usable physics simulator, we hope to bring neural PDE solvers closer to practical use.

物理模拟扩散模型文本生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。