arXiv:2605.31027cs.LG2026-05

提出新型神经网络,高效求解高频偏微分方程。

Multi-Scale Separable Fourier Neural Networks for Solving High-Frequency PDEs

论文配图:Multi-Scale Separable Fourier Neural Networks for Solving High-Frequency PDEs
图 1 · 摘自论文原文
  • 将解分解为坐标独立子网络的乘积,实现多尺度频域特征分离。
  • 在三维高频问题上误差比PINN低90%以上,收敛速度更快。
  • 适合高维、高频物理模拟,尤其适用于科学计算场景。

由于传统架构存在谱偏差,用神经网络求解高频偏微分方程(PDE)极为困难。本文提出多尺度可分离傅里叶神经网络(MS-SFNN),通过显式编码多尺度傅里叶特征,在可分离表示中克服此限制。网络将解分解为 $d$ 个单坐标子网络,权重固定且随机初始化;这些子网络通过逐元素乘积组合成丰富的基函数集。该可分离结构与问题维度呈线性增长,天然缓解维数灾难。关键在于每个子网络配备可训练缩放因子与余弦激活,实现自适应多尺度频率选择,赋予模型强大谱逼近能力。PDE解表示为学习基函数的线性组合,系数通过大规模最小二乘系统求解。为解决高维或高频场景下的内存瓶颈,采用基函数的解析导数替代自动微分,并使用内存高效的批处理QR分解高效求解最小二乘系统。大量数值实验表明,MS-SFNN在精度上显著优于现有方法,包括物理信息神经网络(PINN)和分离变量谱神经网络(SV-SNN)。

原文摘要 · Abstract (English)

Solving high-frequency partial differential equations (PDEs) with neural networks is notoriously difficult due to the spectral bias of conventional architectures. We propose the Multi-Scale Separable Fourier Neural Network (MS-SFNN), a framework designed to overcome this limitation by explicitly encoding multi-scale Fourier features within a separable representation. The network factorizes the solution into $d$ single-coordinate subnetworks with fixed, randomly initialized weights; these subnetworks are combined via element-wise products to form a rich set of basis functions. This separable construction scales linearly with the problem dimension, thus inherently alleviating the curse of dimensionality. Crucially, each subnetwork is equipped with trainable scaling factors coupled with cosine activations, providing an adaptive mechanism for multi-scale frequency selection that endows the model with strong spectral approximation capability. The PDE solution is expressed as a linear combination of these learned basis functions, and the combination coefficients are determined by solving a large-scale least-squares system. To resolve the memory bottleneck in high-frequency or three-dimensional settings, we replace automatic differentiation (AD) with analytical derivatives of the basis functions and use a memory-efficient batched QR decomposition for solving the least-squares systems efficiently. Extensive numerical experiments demonstrate that MS-SFNN achieves superior accuracy and substantially outperforms state-of-the-art methods, including Physics-Informed Neural Network (PINN) and the Separated-Variable Spectral Neural Network (SV-SNN).

偏微分方程神经网络高频求解傅里叶网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。