首个针对偏微分方程逆问题的综合基准数据集,助力神经网络参数估计研究。
PDEInvBench: A Comprehensive Dataset and Design Space Exploration of Neural Networks for PDE Inverse Problems

- 构建覆盖时变与稳态PDE的逆问题数据集,支持分布内与分布外评估
- 两阶段训练最优:先用参数监督,再用PDE残差测试时微调
- 加入导数特征可提升精度,多样初值比扩大参数范围更有效
偏微分方程(PDE)逆问题旨在从观测到的时空解场中估计系统物理参数。由于神经网络擅长建模函数到函数的空间变换,因此在PDE参数估计中表现优异。然而,现有机器学习对PDE的基准主要聚焦于正问题,缺乏针对逆问题——即从解场映射到物理参数——的综合性研究与数据集。为此,我们提出PDEInvBench,一个涵盖时变与稳态PDE的综合性基准数据集,覆盖广泛的物理行为与参数。数据集包含用于评估分布内及多种分布外情形的划分。基于该数据集,我们沿三个关键维度全面探索神经网络设计空间:(1) 优化方法,分析监督、自监督与测试时训练目标的作用;(2) 问题表示,研究不同归纳偏置架构与条件策略的价值;(3) 扩展性,考察模型与数据规模的影响。实验揭示多个实用洞见:1)两阶段训练表现最佳——先以参数监督预训练,再以PDE残差进行测试时微调;2)将PDE导数作为输入特征能持续提升精度;3)增加初始条件多样性带来的性能提升超过扩展参数范围。我们已公开数据集与代码库。
原文摘要 · Abstract (English)
Inverse problems in partial differential equations (PDEs) involve estimating the physical parameters of a system from observed spatiotemporal solution fields. Neural networks are well-suited for PDE parameter estimation due to their capability to model function-to-function space transformations. While existing benchmarks of machine learning methods for PDEs primarily focus on the forward problem, there are no similar comprehensive studies and benchmark datasets on PDE inverse problems, i.e., mapping solution fields to underlying physical parameters. We fill this gap by introducing PDEInvBench, a comprehensive benchmark dataset consisting of numerical simulations for both time-dependent and time-independent PDEs across a wide range of physical behaviors and parameters. Our dataset includes evaluation splits that assess performance in both in-distribution and various out-of-distribution settings. Using our benchmark dataset, we comprehensively explore the design space of neural networks for PDE inverse problems along three key dimensions: (1) optimization procedures, analyzing the role of supervised, self-supervised, and test-time training objectives on performance, (2) problem representations, where we study the value of architectural choices with different inductive biases and various conditioning strategies, and (3) scaling, which we perform with respect to both model and data size. Our experiments reveal several practical insights: 1) neural networks perform best with a two-stage training procedure: initial supervision with PDE parameters followed by test-time fine-tuning using the PDE residual, 2) incorporating PDE derivatives as input features consistently improves accuracy, and 3) increasing the diversity of initial conditions in the training data yields greater performance gains than expanding the range of PDE parameters. We make our dataset and codebase publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。