HyPINO用神经算子零样本求解多类偏微分方程,精度超现有方法。
HyPINO: Multi-Physics Neural Operators via HyperPINNs and the Method of Manufactured Solutions
- 基于Swin Transformer的超网络,结合构造解与物理约束训练。
- 零样本在7个基准上优于U-Net、Poseidon等模型,最佳降噪超100倍。
- 可迭代生成修正模型,适合需快速部署的复杂方程求解场景。
我们提出HyPINO,一种用于零样本泛化的多物理神经算子,无需任务特定微调即可处理广泛类别的偏微分方程(PDE)。该方法结合基于Swin Transformer的超网络与混合监督:(i) 通过制造解法(MMS)生成的解析解标注数据;(ii) 利用物理信息目标优化的无标签样本。模型将PDE参数映射为对应的物理信息神经网络(PINN),可处理二维线性椭圆、双曲与抛物型方程,涵盖不同源项、几何形状及混合狄利克雷/诺伊曼边界条件(含内边界)。HyPINO在七个来自PINN文献的基准问题上实现强零样本精度,优于U-Net、Poseidon和物理信息神经算子(PINO)。此外,我们引入迭代精修过程:将生成的PINN残差视为“δ-PDE”,再进行一次前向传播生成校正型PINN。多次叠加贡献形成集成模型,使六项基准误差持续降低,最优情况下L₂损失降低超过100倍,且保持仅前向推理。进一步评估由HyPINO初始化的PINN微调性能,在五项基准上收敛更快且最终误差更低,其余两项表现相当。结果表明,该可扩展方法为求解更复杂、非线性及高维PDE问题提供了坚实基础。代码与模型权重公开于https://github.com/rbischof/hypino。
原文摘要 · Abstract (English)
We present HyPINO, a multi-physics neural operator designed for zero-shot generalization across a broad class of PDEs without requiring task-specific fine-tuning. Our approach combines a Swin Transformer-based hypernetwork with mixed supervision: (i) labeled data from analytical solutions generated via the Method of Manufactured Solutions (MMS), and (ii) unlabeled samples optimized using physics-informed objectives. The model maps PDE parameterizations to target Physics-Informed Neural Networks (PINNs) and can handle linear elliptic, hyperbolic, and parabolic equations in two dimensions with varying source terms, geometries, and mixed Dirichlet/Neumann boundary conditions, including interior boundaries. HyPINO achieves strong zero-shot accuracy on seven benchmark problems from PINN literature, outperforming U-Nets, Poseidon, and Physics-Informed Neural Operators (PINO). Further, we introduce an iterative refinement procedure that treats the residual of the generated PINN as "delta PDE" and performs another forward pass to generate a corrective PINN. Summing their contributions and repeating this process forms an ensemble whose combined solution progressively reduces the error on six benchmarks and achieves a >100x lower $L_2$ loss in the best case, while retaining forward-only inference. Additionally, we evaluate the fine-tuning behavior of PINNs initialized by HyPINO and show that they converge faster and to lower final error than both randomly initialized and Reptile-meta-learned PINNs on five benchmarks, performing on par on the remaining two. Our results highlight the potential of this scalable approach as a foundation for extending neural operators toward solving increasingly complex, nonlinear, and high-dimensional PDE problems. The code and model weights are publicly available at https://github.com/rbischof/hypino.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。