用领域特征傅里叶编码提升物理神经网络精度与可解释性
Enhancing Physics-Informed Neural Networks with Domain-aware Fourier Features: Towards Improved Performance and Interpretable Results
- 引入领域感知傅里叶特征,自动融入几何与边界信息
- 误差降低数量级,收敛速度更快,无需额外边界损失项
- 结合LRP实现物理一致性特征归因,适合科学计算与可解释建模
物理信息神经网络(PINNs)通过将偏微分方程(PDE)嵌入损失函数来融合物理规律。尽管在学习潜在物理机制方面取得成功,但其训练困难且难以解释。本文提出一种新方法,利用领域感知傅里叶特征(DaFFs)对输入空间进行位置编码。该特征捕捉几何与边界条件等域特性,无需显式边界条件损失项和损失平衡策略,简化优化过程并降低训练计算成本。我们还构建了针对PINNs的LRP可解释性框架,用于提取输入空间的相关性得分。结果表明,PINN-DaFFs相比原始PINNs和基于随机傅里叶特征(RFFs)的PINNs,误差降低数量级,收敛更快。此外,LRP分析显示,本方法生成更符合物理规律的特征归因,而传统PINN-RFFs和原始PINNs则呈现分散且不相关的模式。这证明DaFFs不仅能提升精度与效率,还能增强可解释性,为更鲁棒、更透明的物理信息学习奠定基础。
原文摘要 · Abstract (English)
Physics-Informed Neural Networks (PINNs) incorporate physics into neural networks by embedding partial differential equations (PDEs) into their loss function. Despite their success in learning the underlying physics, PINN models remain difficult to train and interpret. In this work, a novel modeling approach is proposed, which relies on the use of Domain-aware Fourier Features (DaFFs) for the positional encoding of the input space. These features encapsulate all the domain-specific characteristics, such as the geometry and boundary conditions, and unlike Random Fourier Features (RFFs), eliminate the need for explicit boundary condition loss terms and loss balancing schemes, while simplifying the optimization process and reducing the computational cost associated with training. We further develop an LRP-based explainability framework tailored to PINNs, enabling the extraction of relevance attribution scores for the input space. It is demonstrated that PINN-DaFFs achieve orders-of-magnitude lower errors and allow faster convergence compared to vanilla PINNs and RFFs-based PINNs. Furthermore, LRP analysis reveals that the proposed leads to more physically consistent feature attributions, while PINN-RFFs and vanilla PINNs display more scattered and less physics-relevant patterns. These results demonstrate that DaFFs not only enhance PINNs' accuracy and efficiency but also improve interpretability, laying the ground for more robust and informative physics-informed learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。