用连续卷积解决不规则网格的偏微分方程求解,更省内存更快。
CALM-PDE: Continuous and Adaptive Convolutions for Latent Space Modeling of Time-dependent PDEs
- 设计连续卷积架构,自适应选择查询点并约束邻域核
- 在规则与不规则网格上均表现优秀,精度媲美或超越现有方法
- 适合需要高效求解复杂物理模拟的科研与工程场景
在气候模拟和流体动力学等科学工程领域,对时间依赖型偏微分方程(PDE)进行高密度空间离散求解是基础挑战。直接在物理空间计算往往成本高昂。已有神经代理模型通过压缩潜空间降低复杂度,但多采用Transformer注意力机制处理非规则采样域,导致内存开销大。相比之下,卷积网络虽内存效率高,却仅适用于规则离散化。为此,本文提出CALM-PDE,一种可在压缩潜空间中高效求解任意离散化PDE的模型。其创新性地引入基于epsilon邻域约束的连续卷积编码器-解码器结构,学习在自适应优化的查询点上应用卷积算子。实验表明,CALM-PDE在多种具有规则与非规则空间采样的PDE任务中表现优异,精度与现有基线相当或更优,且显著优于基于Transformer的方法,在内存占用和推理速度方面实现大幅优化。
原文摘要 · Abstract (English)
Solving time-dependent Partial Differential Equations (PDEs) using a densely discretized spatial domain is a fundamental problem in various scientific and engineering disciplines, including modeling climate phenomena and fluid dynamics. However, performing these computations directly in the physical space often incurs significant computational costs. To address this issue, several neural surrogate models have been developed that operate in a compressed latent space to solve the PDE. While these approaches reduce computational complexity, they often use Transformer-based attention mechanisms to handle irregularly sampled domains, resulting in increased memory consumption. In contrast, convolutional neural networks allow memory-efficient encoding and decoding but are limited to regular discretizations. Motivated by these considerations, we propose CALM-PDE, a model class that efficiently solves arbitrarily discretized PDEs in a compressed latent space. We introduce a novel continuous convolution-based encoder-decoder architecture that uses an epsilon-neighborhood-constrained kernel and learns to apply the convolution operator to adaptive and optimized query points. We demonstrate the effectiveness of CALM-PDE on a diverse set of PDEs with both regularly and irregularly sampled spatial domains. CALM-PDE is competitive with or outperforms existing baseline methods while offering significant improvements in memory and inference time efficiency compared to Transformer-based methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。