轻量多任务傅里叶神经算子,高效重建稀疏多场数据
MTL-FNO: A Lightweight Multi-Task Fourier Neural Operator for Sparse Field Reconstruction
- 共享参数+低秩任务特化,实现多场联合建模与压缩
- 少样本下精度媲美标准FNO,模型大小减少60%-76%
- 相位幅度解耦优化,解决多任务冲突,适合航天器在线部署
星载多场稀疏重建对航空航天自主运行至关重要。现有深度学习模型虽在单场重建中表现良好,但部署多个独立模型会导致模型规模急剧膨胀,且难以利用跨场相关性,尤其在少样本条件下。为此,本文提出轻量级多任务傅里叶神经算子(MTL-FNO),基于硬参数共享的端到端联合训练框架。每层参数分为共享与任务特化部分,以捕捉共性特征并保留任务特性;任务特化参数采用低秩形式,实现显著压缩。为解决共享与任务特化参数及其实虚部的协同优化难题,本文从极坐标视角重审FNO谱权重,提出物理意义明确的解耦优化方案:通过逐片极分解将谱权重拆分为表征相位的酉张量与表征幅度的半正定张量,解耦相位与幅度优化,有效缓解任务冲突。同时引入Cayley变换重构酉张量,将约束优化转为无约束问题,保持几何保真度。在两个典型工程案例中验证了该方法在少样本条件下的有效性。结果表明,MTL-FNO在精度上可媲美或超越标准FNO,总模型规模分别减少76%和60%。
原文摘要 · Abstract (English)
Efficient onboard multi-field sparse reconstruction is essential for the autonomous operation of aerospace vehicles. While existing deep learning models exhibit promise for single-field reconstruction, deploying multiple independent models leads to prohibitive model size growth and fails to exploit cross-field correlations, particularly under few-shot conditions. To address these challenges, we first propose a lightweight multi-task Fourier neural operator (MTL-FNO), an end-to-end joint training framework based on hard parameter sharing. In each layer, the parameters are divided into shared and task-specific components to capture common features across fields while preserving task-specific characteristics. Moreover, the task-specific fine-tuning parameters are implemented as low-rank terms, achieving substantial model compression. Second, to address the difficulty of co-optimizing shared and task-specific parameters along with their real and imaginary parts, we revisit the FNO's spectral weight from a polar-form perspective and devise a physically meaningful decoupled optimization scheme. Specifically, we apply polar decomposition to slice-wise disentangle the spectral weight into a unitary tensor encoding phase information and a positive semi-definite tensor characterizing amplitude. By decoupling the optimization of phase and amplitude, our method can effectively mitigate tasks conflict. Meanwhile, to preserve unitary geometric fidelity during training, the Cayley transform is introduced to reparameterize the unitary tensor, converting the constrained optimization problem to an unconstrained one. Finally, the effectiveness of the proposed method under few-shot conditions is validated on two representative engineering cases. Results show that MTL-FNO achieves accuracy comparable to or even surpassing that of standard FNO, while reducing total model size by 76% and 60%, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。