用物理模型生成真实数据,提升干涉高光谱图像重建质量
Physical Degradation Model-Guided Interferometric Hyperspectral Reconstruction with Unfolding Transformer
- 基于成像物理构建退化模型,合成逼真训练数据
- 提出unfolded Transformer架构,有效修复条纹与细节
- 适合遥感图像重建、深度学习数据稀缺场景
干涉高光谱成像(IHI)因通量和光谱分辨率优势,在大范围遥感中至关重要。但其成像过程易受多类误差影响,现有基于信号处理的重建算法性能受限。主要挑战在于:1)缺乏训练数据;2)学习方法难以消除IHI特有的退化成分。为此,本文提出新型IHI重建流程:首先,基于成像物理与辐射定标数据,建立简化但精确的IHI退化模型及参数估计方法,可从高光谱图像(HSIs)合成真实IHI训练数据,弥合重建与深度学习之间的鸿沟。其次,设计干涉高光谱重建unfolded Transformer(IHRUT),通过条纹增强机制与时空-光谱Transformer结构,实现有效光谱校正与细节恢复。实验表明,该方法在性能与泛化能力上均显著优于现有方法。代码已开源:https://github.com/bit1120203554/IHRUT。
原文摘要 · Abstract (English)
Interferometric Hyperspectral Imaging (IHI) is a critical technique for large-scale remote sensing tasks due to its advantages in flux and spectral resolution. However, IHI is susceptible to complex errors arising from imaging steps, and its quality is limited by existing signal processing-based reconstruction algorithms. Two key challenges hinder performance enhancement: 1) the lack of training datasets. 2) the difficulty in eliminating IHI-specific degradation components through learning-based methods. To address these challenges, we propose a novel IHI reconstruction pipeline. First, based on imaging physics and radiometric calibration data, we establish a simplified yet accurate IHI degradation model and a parameter estimation method. This model enables the synthesis of realistic IHI training datasets from hyperspectral images (HSIs), bridging the gap between IHI reconstruction and deep learning. Second, we design the Interferometric Hyperspectral Reconstruction Unfolding Transformer (IHRUT), which achieves effective spectral correction and detail restoration through a stripe-pattern enhancement mechanism and a spatial-spectral transformer architecture. Experimental results demonstrate the superior performance and generalization capability of our method.The code and are available at https://github.com/bit1120203554/IHRUT.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。