通过双域建模提升高光谱图像融合的几何与光谱精度。
Dual-Domain Manifold Modeling for Hyperspectral Image Fusion

- 构建空间-光谱双域流形模型,联合捕捉几何结构与像素关系。
- 频域解耦融合模块增强高频细节,提升边缘与纹理恢复能力。
- 适合需要高保真图像融合的遥感、医学成像等应用。
实现高光谱图像融合中光谱丰富性与空间保真度的协同整合仍是核心目标。然而现有方法难以有效建模几何约束:在空间域,空间-光谱交互弱导致结构感知特征学习不足,抑制高频结构信息,产生低频偏差和结构退化;在光谱域,由光谱相似性诱导的局部流形结构未被充分挖掘,限制了像素内在关系建模与细粒度光谱重建。为此,本文提出双域流形建模(DDMM)框架。具体地,设计拓扑感知注意力机制(TPFormer),结合全局注意力与邻域传播,联合建模空间拓扑与像素级特征流形关系,以捕获内在空间-光谱结构并提升拓扑感知表示学习。此外,提出频域解耦的空间-光谱协同融合(FDSCF)模块,通过离散余弦变换将特征投影至频域,并显式解耦为低频与高频成分。基于低秩结构先验与光谱驱动的空间增强,FDSCF选择性增强几何感知高频特征,强化空间-光谱耦合,恢复更清晰的边缘与精细纹理。在多个基准数据集上的大量实验表明,DDMM在空间结构保持与光谱重建方面均优于当前最优方法。
原文摘要 · Abstract (English)
Achieving a coherent integration of spectral richness and spatial fidelity remains a central objective in hyperspectral image fusion. However, existing hyperspectral image fusion methods struggle to effectively model geometric constraints. In the spatial domain, weak spatial-spectral interaction limits geometry-aware feature learning and suppresses high-frequency structural information, resulting in low-frequency bias and structural degradation. In the spectral domain, local manifold structures induced by spectral similarity are insufficiently exploited, limiting intrinsic pixel relationship modeling and fine-grained spectral reconstruction. To address these challenges, we propose a dual-domain manifold modeling (DDMM) framework. Specifically, we introduce a Topology-Aware Transformer (TPFormer) that combines global attention with neighborhood propagation, jointly modeling spatial topology and pixel-level feature manifold relationships to capture intrinsic spatial-spectral structures and improve topology-aware representation learning. Furthermore, a Frequency-Decoupled Spatial-Spectral Collaborative Fusion (FDSCF) module is devised, in which features are projected into the frequency domain via the discrete cosine transform and explicitly decoupled into low- and high-frequency components. Guided by a low-rank structural prior and spectral-driven spatial enhancement, FDSCF selectively enhances geometry-aware high-frequency features, strengthening spatia-spectral coupling and recovering sharper edges and finer textures. Extensive experiments on multiple benchmark datasets demonstrate that DDMM achieves superior overall performance over SoTA methods in terms of spatial structure preservation and spectral reconstruction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。