通过选择性剪枝让PINN自动遗忘噪声数据,提升物理方程反问题求解稳定性。
Unlearning Noise in PINNs: A Selective Pruning Framework for PDE Inverse Problems
- 基于残差与数据拟合联合指标划分可靠/污染数据集
- 利用神经元激活偏差识别受噪声影响的敏感单元
- 迭代剪枝后微调,实现轻量级抗噪修复,无需重新训练
物理信息神经网络(PINNs)通过融合观测数据与物理约束,在求解偏微分方程(PDE)反问题上展现出潜力。然而,此类问题本身病态,对噪声极度敏感,少量污染数据即可扭曲网络内部表征,严重降低精度并导致训练不稳定。受机器去学习与结构化剪枝启发,本文提出P-PINN:一种从预训练PINN出发的有选择性地剪枝框架,用于消除污染数据的影响。首先,基于数据残差与物理残差的加权组合,将训练集划分为可靠与污染子集;随后,引入基于偏差的神经元重要性度量,量化两子集间激活方向差异,识别出主要由污染样本驱动的神经元;进而采用迭代剪枝策略逐层移除这些敏感神经元;最终,在可靠数据上以原始物理约束进行微调,形成轻量级后处理流程。大量典型PDE反问题基准测试表明,相比基线方法,该框架在噪声环境下显著提升鲁棒性、准确率与训练稳定性,相对误差最高降低96.6%。结果表明,激活层面的后处理剪枝是增强噪声污染场景下物理信息学习可靠性的有效机制。
原文摘要 · Abstract (English)
Physics-informed neural networks (PINNs) provide a promising framework for solving inverse problems governed by partial differential equations (PDEs) by integrating observational data and physical constraints in a unified optimization objective. However, the ill-posed nature of PDE inverse problems makes them highly sensitive to noise. Even a small fraction of corrupted observations can distort internal neural representations, severely impairing accuracy and destabilizing training. Motivated by recent advances in machine unlearning and structured network pruning, we propose P-PINN, a selective pruning framework designed to unlearn the influence of corrupted data in a pretrained PINN. Specifically, starting from a PINN trained on the full dataset, P-PINN evaluates a joint residual--data fidelity indicator, a weighted combination of data misfit and PDE residuals, to partition the training set into reliable and corrupted subsets. Next, we introduce a bias-based neuron importance measure that quantifies directional activation discrepancies between the two subsets, identifying neurons whose representations are predominantly driven by corrupted samples. Building on this, an iterative pruning strategy then removes noise-sensitive neurons layer by layer. The resulting pruned network is fine-tuned on the reliable data subject to the original PDE constraints, acting as a lightweight post-processing stage rather than a complete retraining. Numerical experiments on extensive PDE inverse-problem benchmarks demonstrate that P-PINN substantially improves robustness, accuracy, and training stability under noisy conditions, achieving up to a 96.6% reduction in relative error compared with baseline PINNs. These results indicate that activation-level post hoc pruning is a promising mechanism for enhancing the reliability of physics-informed learning in noise-contaminated settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。