用分层半可分结构提升神经PDE求解器的数据效率
Neural-HSS: Hierarchical Semi-Separable Neural PDE Solver
- 基于分层半可分矩阵设计参数高效网络架构
- 在低数据量下仍能精确求解三维泊松方程(200万网格点)
- 适用于电磁、流体、生物等多领域椭圆型PDE问题
基于深度学习的PDE求解方法虽能实现快速仿真,但大规模高质量数据集的生成与模型训练仍面临巨大计算成本。受椭圆型PDE格林函数结构启发,本文提出Neural-HSS——一种基于分层半可分(HSS)矩阵结构的参数高效神经架构,理论上证明其对一大类PDE具有数据高效性,即使在极低数据条件下也具备精确性。该架构与傅里叶神经算子层和卷积层存在关联。实验验证其在包含两百万网格点的三维泊松方程上,于低数据场景下显著优于基线方法;同时展示其在电磁学、流体动力学及生物学等多样领域中对广泛PDE数据的建模能力。
原文摘要 · Abstract (English)
Deep learning-based methods have shown remarkable effectiveness in solving PDEs, largely due to their ability to enable fast simulations once trained. However, despite the availability of high-performance computing infrastructure, many critical applications remain constrained by the substantial computational costs associated with generating large-scale, high-quality datasets and training models. In this work, inspired by studies on the structure of Green's functions for elliptic PDEs, we introduce Neural-HSS, a parameter-efficient architecture built upon the Hierarchical Semi-Separable (HSS) matrix structure that is provably data-efficient for a broad class of PDEs. We theoretically analyze the proposed architecture, proving that it satisfies exactness properties even in very low-data regimes. We also investigate its connections with other architectural primitives, such as the Fourier neural operator layer and convolutional layers. We experimentally validate the data efficiency of Neural-HSS on the three-dimensional Poisson equation over a grid of two million points, demonstrating its superior ability to learn from data generated by elliptic PDEs in the low-data regime while outperforming baseline methods. Finally, we demonstrate its capability to learn from data arising from a broad class of PDEs in diverse domains, including electromagnetism, fluid dynamics, and biology.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。