用新增维度建模嵌入演化,提升神经算子精度与效率
Reformulating Neural Operators in $d+1$ Dimensions for Embedding Evolution
- 引入辅助维度,在d+1空间中以算子形式建模嵌入演化
- 多任务测试中相对误差最低,3D不稳定性问题也表现优异
- 支持零样本泛化,适合需要高效高精度的科学计算场景
神经算子(NOs)是学习函数空间间映射的强大架构。尽管多数进展聚焦于物理域上核参数化的优化,但升维嵌入的演化仍缺乏探索,常导致模型依赖计算成本高的嵌入放大设计以提升近似能力。本文提出在 $d+1$ 维空间重构神经算子流程,引入辅助函数维度,以算子形式建模嵌入演化。通过基于傅里叶的算子联合作用于物理与辅助域,实现基函数多样化的辅助演化模块,替代暴力嵌入扩展。在十余个日益复杂的基准测试中,涵盖一维热方程至高度非线性的三维瑞利-泰勒不稳定性,本模型始终取得最低的相对 $L_2$ 误差。关键优势经三方面验证:(1)预算可控的对比实验,优于缩放与消融基线;(2)混合分辨率训练与超分辨率推理下的鲁棒性;(3)对未见时间区间的零样本泛化。此外,我们系统分析了升维与恢复算子的设计选择,揭示其对预测性能的影响。
原文摘要 · Abstract (English)
Neural Operators (NOs) are powerful architectures for learning mappings between function spaces. While most advances focus on refining kernel parameterizations over the $d$-dimensional physical domain, the evolution of lifted embeddings remains underexplored, which often drives models toward computationally expensive embedding-scaling designs to improve approximation. In this paper, we introduce an auxiliary function dimension that models embedding evolution in operator form, thereby reformulating the NO pipeline in $d+1$ dimensions. We instantiate this framework via Fourier-based operators acting jointly on the physical and auxiliary domains, yielding a basis-diversified auxiliary evolution module as an alternative to brute-force embedding scaling. Across more than ten increasingly challenging benchmarks, ranging from the 1D heat equation to the highly nonlinear 3D Rayleigh-Taylor instability, our model consistently achieves the lowest relative $L_2$ error among the evaluated baselines. Crucially, this advantage is empirically supported by (1) controlled budget-aware comparisons against scaled and ablated baselines; (2) robustness under mixed-resolution training and super-resolution inference; and (3) zero-shot generalization to unseen temporal regimes. In addition, we present a broader set of design choices for lifting and recovery operators, demonstrating their impact on our model's predictive performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。