arXiv:2604.12463cs.CVcs.AI2026-04

用数学公式重构遥感图像融合,速度更快更保真。

Euler-inspired Decoupling Neural Operator for Efficient Pansharpening

  • 基于欧拉公式将特征转到极坐标系,分离空间与光谱处理。
  • 在三个数据集上实现更快推理速度,且保持高光谱保真度。
  • 适合需要高效高精度图像融合的遥感应用开发者。

全色锐化旨在通过融合全色(PAN)图像的空间纹理与低分辨率多光谱(LR-MS)图像的光谱信息,生成高分辨率多光谱(HR-MS)图像。尽管基于扩散模型的深度学习方法显著提升了性能,但其固有的随机性与迭代采样常导致光谱-空间模糊及高昂计算成本。本文提出欧拉启发的解耦神经算子(EDNO),一种受物理启发的框架,将全色锐化重新定义为频域中的连续函数映射。不同于传统笛卡尔特征处理,EDNO利用欧拉公式将特征转换至极坐标系,引入新型显式-隐式交互机制。具体地,设计欧拉特征交互层(EFIL),将融合任务解耦为两个专用模块:1)显式特征交互模块,采用线性加权模拟相位旋转,实现自适应几何对齐;2)隐式特征交互模块,使用前馈网络建模光谱分布,提升色彩一致性。在频域操作使EDNO天然具备全局感受野并保持离散化不变性。三组数据集上的实验表明,相比重型架构,EDNO在效率与性能间实现了更优平衡。

原文摘要 · Abstract (English)

Pansharpening aims to synthesize high-resolution multispectral (HR-MS) images by fusing the spatial textures of panchromatic (PAN) images with the spectral information of low-resolution multispectral (LR-MS) images. While recent deep learning paradigms, especially diffusion-based operators, have pushed the performance boundaries, they often encounter spectral-spatial blurring and prohibitive computational costs due to their stochastic nature and iterative sampling. In this paper, we propose the Euler-inspired Decoupling Neural Operator (EDNO), a physics-inspired framework that redefines pansharpening as a continuous functional mapping in the frequency domain. Departing from conventional Cartesian feature processing, our EDNO leverages Euler's formula to transform features into a polar coordinate system, enabling a novel explicit-implicit interaction mechanism. Specifically, we develop the Euler Feature Interaction Layer (EFIL), which decouples the fusion task into two specialized modules: 1) Explicit Feature Interaction Module, utilizing a linear weighting scheme to simulate phase rotation for adaptive geometric alignment; and 2) Implicit Feature Interaction Module, employing a feed-forward network to model spectral distributions for superior color consistency. By operating in the frequency domain, EDNO inherently captures global receptive fields while maintaining discretization-invariance. Experimental results on the three datasets demonstrate that EDNO offers a superior efficiency-performance balance compared to heavyweight architectures.

图像融合神经算子遥感

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。