用卷积网络增强FNO的局部特征捕捉能力,提升偏微分方程求解精度。
Enhancing Fourier Neural Operators with Local Spatial Features
- 引入卷积网络预提取输入数据中的局部空间特征
- 在多个挑战性PDE基准上显著提升FNO性能
- 设计两种新缩放策略实现分辨率不变性,适合高精度科学计算
偏微分方程(PDE)问题通常具有强烈的局部空间结构,有效捕捉这些结构对近似其解至关重要。近年来,傅里叶神经算子(FNO)已成为求解此类问题的高效方法,通过频域参数化能高效捕获全局模式。然而,这种设计天然忽略了局部空间特征的作用,因为频域参数化卷积主要强调全局交互,未充分编码局部依赖关系。尽管已有研究尝试解决此问题,但提取的局部空间特征(LSFs)仍不充分,且常牺牲计算效率。为此,我们引入基于卷积神经网络(CNN)的特征预提取器,直接从输入数据中捕获LSFs,形成混合架构Conv-FNO。同时,我们提出两种新型缩放方案,使Conv-FNO具备分辨率不变性。本工作通过理论分析与大量数值实验,验证了将LSFs融入FNO的有效性。结果表明,这一简单而有效的改进显著增强了FNO的表达能力,在多个挑战性PDE基准上取得显著性能提升。
原文摘要 · Abstract (English)
Partial Differential Equation (PDE) problems often exhibit strong local spatial structures, and effectively capturing these structures is critical for approximating their solutions. Recently, the Fourier Neural Operator (FNO) has emerged as an efficient approach for solving these PDE problems. By using parametrization in the frequency domain, FNOs can efficiently capture global patterns. However, this approach inherently overlooks the critical role of local spatial features, as frequency-domain parameterized convolutions primarily emphasize global interactions without encoding comprehensive localized spatial dependencies. Although several studies have attempted to address this limitation, their extracted Local Spatial Features (LSFs) remain insufficient, and computational efficiency is often compromised. To address this limitation, we introduce a convolutional neural network (CNN)-based feature pre-extractor to capture LSFs directly from input data, resulting in a hybrid architecture termed \textit{Conv-FNO}. Furthermore, we introduce two novel resizing schemes to make our Conv-FNO resolution invariant. In this work, we focus on demonstrating the effectiveness of incorporating LSFs into FNOs by conducting both a theoretical analysis and extensive numerical experiments. Our findings show that this simple yet impactful modification enhances the representational capacity of FNOs and significantly improves performance on challenging PDE benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。