用光谱与结构提示增强Mamba模型,提升高光谱图像超分辨率质量。
USP-Mamba: Unmixing-Derived Spectral and Structural Prompting for Hyperspectral Image Super-Resolution

- 通过解混引导的光谱提示和图像依赖的结构提示,改进Mamba状态演化。
- 在多个数据集上优于现有方法,尤其在保留细节和光谱一致性方面表现突出。
- 适合高光谱图像处理、遥感影像增强领域的研究人员和工程师。
高光谱图像超分辨率旨在重建高分辨率图像的同时保持密集光谱信息。近期基于Mamba的模型因其线性计算复杂度下捕捉长距离依赖的潜力而展现出前景。然而,其因果序列建模需将二维高光谱特征按预设扫描顺序展开,破坏空间邻接性,限制上下文信息的有效传播。此外,现有模型的状态空间参数化主要基于通用学习表征,未显式对齐高光谱图像内在特性。为此,本文提出一种解混引导的光谱与结构提示Mamba框架(USP-Mamba),通过融合感知光谱先验和图像依赖结构提示来适应Mamba状态演化。具体而言,解混启发的光谱提示捕获输入图像的全局物质组成,并在重建过程中持续提供条件;该提示注入到Mamba序列中,并逐层动态调整,引导状态演化向成分一致的方向进行。引入包含空间与频率分量的特征级结构提示,提供图像依赖的局部引导:空间提示促进结构敏感的状态编码以保留局部细节,频率提示实现均匀区域与高频细节间的自适应过渡。最后,互补的希尔伯特扫描与语义引导邻域扫描共同维持空间连续性并强化非局部语义依赖建模。大量实验表明,所提方法在不同数据集上持续优于代表性方法。
原文摘要 · Abstract (English)
Hyperspectral image super-resolution aims to reconstruct high-resolution imagery while preserving dense spectral information. Recently, Mamba-based models have shown promising potential for this task by capturing long-range dependencies with linear computational complexity. Nevertheless, their causal sequence modeling requires two-dimensional hyperspectral features to be unfolded along predefined scanning orders, which disrupts spatial adjacency and restricts the effective propagation of contextual information. Moreover, state-space parameterization of existing models is predominantly derived from generic learned representations, without explicit alignment with the intrinsic characteristics of the hyperspectral image. To address this issue, we propose an Unmixing-derived Spectral and Structural Prompting Mamba framework, termed USP-Mamba, which adapts Mamba state evolution through composition-aware spectral priors and image-dependent structural prompts. Specifically, an unmixing-informed spectral prompt captures the global material composition of the input image and provides persistent conditioning throughout reconstruction. Injected into the Mamba sequence and progressively adapted across layers, it steers state evolution toward composition-consistent reconstruction. We introduce feature-level structural prompts comprising spatial and frequency components to provide image-dependent local guidance. The spatial prompt promotes structure-sensitive state encoding for local detail preservation, while the frequency prompt enables region-adaptive transitions between homogeneous regions and high-frequency details. Finally, complementary Hilbert and Semantic-Guided Neighboring scans preserve spatial continuity and strengthen non-local semantic dependency modeling. Extensive experiments on different datasets demonstrate that the proposed method consistently outperforms representative approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。