arXiv:2605.07375cs.LGcs.CE2026-05

提出新型归一化方法,让神经算子在不同网格分辨率下表现更稳定。

QuadNorm: Resolution-Robust Normalization for Neural Operators

论文配图:QuadNorm: Resolution-Robust Normalization for Neural Operators
图 1 · 摘自论文原文
  • 用数值积分替代均匀平均,实现跨分辨率归一化
  • 在64²到256²网格上均优于现有方法,误差随网格间距平方衰减
  • 特别适合非周期性微分方程和非谱架构,可作为默认方案

神经算子中的归一化层通常通过对离散网格值进行均匀平均计算统计量,导致归一化本身依赖于离散化方式,成为跨分辨率迁移的误差来源。为实现离散化鲁棒性,本文引入一种基于数值积分的归一化家族——QuadNorm与BlendQuadNorm,替代原有均匀平均。在包含端点的均匀网格上,所提出的积分矩对网格间距 $h$ 具有 $O(h^2)$ 一致性,即跨分辨率偏差随网格间距平方衰减。转移误差界预测了归一化引起的偏差如何随分辨率差异和网络深度变化,实验验证了该趋势。在Darcy问题中,QuadNorm在从 $64^2$ 到 $256^2$ 的所有目标分辨率上均表现最优;在真实数据基准上,使用QuadNorm的Transolver几乎实现分辨率不变的迁移。最大提升出现在非周期性偏微分方程和非谱架构上,同时本地分辨率性能也得到改善。此外,BlendQuadNorm保持接近层归一化行为,适用于周期性FNO场景,可作为保守默认选择。结果表明,归一化是神经算子中此前被忽视的分辨率依赖来源。

原文摘要 · Abstract (English)

Normalization layers in neural operators usually compute statistics by uniformly averaging discrete grid values, making the normalization itself discretization-dependent and thereby a source of transfer error across different resolutions or meshes. To enable discretization robustness, we introduce a quadrature normalization family that replaces existing uniform averaging in normalization layers with numerical quadrature: QuadNorm and BlendQuadNorm. On endpoint-inclusive uniform grids, the proposed quadrature moments are $O(h^2)$-consistent across discretizations, meaning that their cross-resolution mismatch decays quadratically with grid spacing. A transfer-error bound then predicts how normalization-induced mismatch scales with both the resolution gap and network depth. The experiments show the same gap- and depth-scaling trends predicted by the transfer-error bound. On Darcy, QuadNorm delivers the best cross-resolution performance at every tested target resolution from $64^2$ to $256^2$; on real-data benchmarks, Transolver with QuadNorm achieves nearly resolution-invariant transfer. The largest gains appear on nonperiodic PDEs and nonspectral architectures, where native-resolution improvements also emerge. We also validate BlendQuadNorm, which stays close to LayerNorm behavior and serves as a conservative default for periodic FNO settings. These results identify normalization as a previously overlooked source of resolution dependence in neural operators.

神经算子归一化网格鲁棒PDE求解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。