用可学习的形变场构建神经PDE求解器,高效模拟复杂物理过程。
Flowers: A Warp Drive for Neural PDE Solvers
- 基于多头形变场逐点预测位移,通过堆叠实现全局自适应交互。
- 1700万参数模型在2D/3D波动与流体问题上超越同类方法,15000万参数版优于大模型。
- 无需卷积、注意力或傅里叶变换,适合追求高效高精度的物理模拟任务。
我们提出Flowers,一种完全由多头形变场构成的神经PDE求解器架构。除通道混洗和多尺度结构外,不使用傅里叶乘子、点积注意力或卷积混合。每个头预测一个位移场并形变混合输入特征。受物理规律和计算效率启发,位移逐点预测,无空间聚合,非局部性仅通过每头一个源坐标稀疏采样引入。多尺度残差块堆叠形成Flowers,以线性代价实现自适应全局交互。理论动机来自三个互补视角:守恒律的流映射、非均匀介质中的波传播、以及动理学连续极限。Flowers在广泛的2D/3D时变PDE基准测试中表现优异,尤其在流体与波问题上。一个1700万参数模型持续优于同规模的傅里叶、卷积和注意力基线;1.5亿参数版本则超越了需更多参数、数据与训练算力的近期Transformer基础模型。
原文摘要 · Abstract (English)
We introduce Flowers, a neural architecture for learning PDE solution operators built entirely from multihead warps. Aside from pointwise channel mixing and a multiscale scaffold, Flowers use no Fourier multipliers, no dot-product attention, and no convolutional mixing. Each head predicts a displacement field and warps the mixed input features. Motivated by physics and computational efficiency, displacements are predicted pointwise, without any spatial aggregation, and nonlocality enters only through sparse sampling at source coordinates, one per head. Stacking warps in multiscale residual blocks yields Flowers, which implement adaptive, global interactions at linear cost. We theoretically motivate this design through three complementary lenses: flow maps for conservation laws, waves in inhomogeneous media, and a kinetic-theoretic continuum limit. Flowers achieve excellent performance on a broad suite of 2D and 3D time-dependent PDE benchmarks, particularly flows and waves. A compact 17M-parameter model consistently outperforms Fourier, convolution, and attention-based baselines of similar size, while a 150M-parameter variant improves over recent transformer-based foundation models with much more parameters, data, and training compute.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。