提升高光谱图像超分辨率的光谱保真度,解决伪振荡问题。
SR$^{2}$-Net: A General Plug-and-Play Model for Spectral Refinement in Hyperspectral Image Super-Resolution
- 通过增强-校正双阶段设计,强化跨波段交互与物理可实现性约束。
- 在多个基准上显著提升光谱保真度,计算开销极小。
- 可无缝接入各类超分模型,适合需要高精度光谱重建的研究者。
高光谱图像超分辨率(HSI-SR)旨在提升空间分辨率的同时保持光谱真实性和物理合理性。现有方法虽利用空间相关性提升空间细节,但常忽略波段间光谱一致性,导致虚假振荡和物理不可行的伪影。尽管可通过网络结构设计改善光谱一致性,但会牺牲通用性与灵活性。为此,本文提出轻量级即插即用的光谱校正模块——物理先验光谱校正超分辨率网络(SR²-Net),可集成至多种现有HSI-SR模型而无需修改其架构。SR²-Net采用“增强-校正”流程:(i) 层次化光谱-空间协同注意力(H-S³A)增强跨波段关联;(ii) 流形一致性校正(MCR)将重建光谱约束于紧凑、物理合理的光谱流形中。此外,引入退化一致性损失,促使重建输出与低分辨率输入在退化条件下保持一致。在多个基准数据集及不同骨干网络上的实验表明,该方法在不增加显著计算成本的前提下,持续提升光谱保真度与整体重建质量。代码将在发表后公开。
原文摘要 · Abstract (English)
HSI-SR aims to enhance spatial resolution while preserving spectrally faithful and physically plausible characteristics. Recent methods have achieved great progress by leveraging spatial correlations to enhance spatial resolution. However, these methods often neglect spectral consistency across bands, leading to spurious oscillations and physically implausible artifacts. While spectral consistency can be addressed by designing the network architecture, it results in a loss of generality and flexibility. To address this issue, we propose a lightweight plug-and-play rectifier, physically priors Spectral Rectification Super-Resolution Network (SR$^{2}$-Net), which can be attached to a wide range of HSI-SR models without modifying their architectures. SR$^{2}$-Net follows an enhance-then-rectify pipeline consisting of (i) Hierarchical Spectral-Spatial Synergy Attention (H-S$^{3}$A) to reinforce cross-band interactions and (ii) Manifold Consistency Rectification (MCR) to constrain the reconstructed spectra to a compact, physically plausible spectral manifold. In addition, we introduce a degradation-consistency loss to enforce data fidelity by encouraging the degraded SR output to match the observed low resolution input. Extensive experiments on multiple benchmarks and diverse backbones demonstrate consistent improvements in spectral fidelity and overall reconstruction quality with negligible computational overhead. Our code will be released upon publication.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。