arXiv:2602.14663cs.LGcs.NA2026-02

用傅里叶空间伪微分增强物理信息神经网络,提升高频学习与训练效率。

Pseudo-differential-enhanced physics-informed neural networks

  • 在傅里叶空间中通过乘以波数实现微分,替代传统梯度增强。
  • 减少训练迭代次数,提升数值误差精度,尤其适用于少采样场景。
  • 支持分数阶导数,兼容傅里叶特征嵌入,对非欧几何也具灵活性。

我们提出伪微分增强的物理信息神经网络(PINNs),将梯度增强扩展至傅里叶空间。传统方法通过提高微分阶数增强损失函数以改善训练效果,而本方法在傅里叶变换后利用波数乘法实现微分,具有高效性。该方法通常在更少迭代次数内达到优于数值解的误差,尤其适合少量采样点的配置,且可突破低采样时的训练停滞现象。此外,该方法适用于分数阶导数。理论分析表明,其通过动态效应加速神经切线核(NTK)谱值衰减,有助于早期学习高频成分,缓解频率偏差问题,直至多项式阶数甚至更高(使用光滑激活函数时)。该方法兼容傅里叶特征嵌入等先进技术。离散傅里叶变换依赖网格,为此我们通过蒙特卡洛方法等实现对欧几里得与非欧几何域的灵活适配。

原文摘要 · Abstract (English)

We present pseudo-differential enhanced physics-informed neural networks (PINNs), an extension of gradient enhancement but in Fourier space. Gradient enhancement of PINNs dictates that the PDE residual is taken to a higher differential order than prescribed by the PDE, added to the objective as an augmented term in order to improve training and overall learning fidelity. We propose the same procedure after application via Fourier transforms, since differentiating in Fourier space is multiplication with the Fourier wavenumber under suitable decay. Our methods are fast and efficient. Our methods oftentimes achieve superior PINN versus numerical error in fewer training iterations, potentially pair well with few samples in collocation, and can on occasion break plateaus in low collocation settings. Moreover, our methods are suitable for fractional derivatives. We establish that our methods, due to the dynamical effects, improve spectral eigenvalue decay of the neural tangent kernel (NTK), and so our methods contribute towards the learning of high frequencies in early training, mitigating the effects of frequency bias up to the polynomial order and possibly greater with smooth activations. Our methods accommodate advanced techniques in PINNs, such as Fourier feature embeddings. A pitfall of discrete Fourier transforms via the Fast Fourier Transform (FFT) is mesh subjugation, and so we demonstrate compatibility of our methods for greater mesh flexibility and invariance on alternative Euclidean and non-Euclidean domains via Monte Carlo methods and otherwise.

PINNs傅里叶空间高频学习分数阶导数

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。