arXiv:2507.21833cs.LGcs.AI2025-07

用有效场论解析FNO的频率行为,揭示非线性如何影响模型稳定性与泛化。

Analysis of Fourier Neural Operators via Effective Field Theory

  • 通过有效场论推导FNO层核与四点顶点的递归关系
  • 发现非线性会将低频输入耦合至高频模式,实验验证频率转移现象
  • 提出匹配初始化方法,显著提升FNO在Burgers方程上的训练稳定性和精度

傅里叶神经算子(FNO)已成为求解各类函数问题的主流代理算子,但其稳定性、泛化能力及频率特性缺乏系统解释。本文在无限维函数空间中对FNO进行系统的有效场论分析,推导出层核与四点顶点的闭式递归关系,并考察了三种实际重要情形:解析激活函数、尺度不变情况以及含残差连接的架构。理论表明,非线性激活不可避免地将频率输入耦合至谱截断所丢弃的高频模式,实验验证了这种频率转移。对于宽网络,我们推导出权重初始化集合的显式临界条件,确保输入扰动在深度上保持均匀尺度,实验确认了理论预测的核扰动比例与测量值一致。结果量化了非线性如何使神经算子捕捉复杂特征,提供了基于临界性分析的超参数选择准则,并解释了尺度不变激活与残差连接为何增强特征学习。最后,我们将临界性理论转化为实用的匹配初始化(校准)程序;在标准PDEBench Burgers基准测试中,校准后的FNO表现出更稳定的优化过程、更快的收敛速度和更低的测试误差。

原文摘要 · Abstract (English)

Fourier Neural Operators (FNOs) have emerged as leading surrogates for solver operators for various functional problems, yet their stability, generalization and frequency behavior lack a principled explanation. We present a systematic effective field theory analysis of FNOs in an infinite-dimensional function space, deriving closed recursion relations for the layer kernel and four-point vertex and then examining three practically important settings-analytic activations, scale-invariant cases and architectures with residual connections. The theory shows that nonlinear activations inevitably couple frequency inputs to high frequency modes that are otherwise discarded by spectral truncation, and experiments confirm this frequency transfer. For wide networks, we derive explicit criticality conditions on the weight initialization ensemble that ensure small input perturbations maintain a uniform scale across depth, and we confirm experimentally that the theoretically predicted ratio of kernel perturbations matches the measurements. Taken together, our results quantify how nonlinearity enables neural operators to capture non-trivial features, supply criteria for hyperparameter selection via criticality analysis, and explain why scale-invariant activations and residual connections enhance feature learning in FNOs. Finally, we translate the criticality theory into a practical criterion-matched initialization (calibration) procedure; on a standard PDEBench Burgers benchmark, the calibrated FNO exhibits markedly more stable optimization, faster convergence, and improved test error relative to a vanilla FNO.

神经算子有效场论频率分析PDE求解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。