基于物理模型的红外高光谱图像修复,提升真实场景还原度。
HADAR-Based Thermal Infrared Hyperspectral Image Restoration

- 引入热辐射物理方程建模温度/发射率/纹理三元组,实现物理一致修复。
- 在户外与实验室数据上,噪声抑制、缺损填补和光谱超分辨率均优于现有方法。
- 适合从事红外成像、遥感感知或物理驱动算法研究的学者使用。
热红外(TIR)高光谱影像在诸多应用中提供关键场景信息,但其实际效用受传感器特有退化影响严重,现有恢复方法因忽略热物理机制而表现受限。本文提出HAIR(基于HADAR的图像恢复)框架,融合热辐射渲染方程(HRE)与大气下行辐射传输方程(RTE),以温度、发射率和纹理(TeX)物理三元组建模TIR-HSI。该物理模型催生了分解-合成策略,确保物理一致性与时空谱噪声鲁棒性。同时,利用前向建模的大气下行参考,结合发射率与黑体辐射的光谱平滑性,实现难以达成的光谱校准与生成。在户外DARPA Invisible Headlights数据集及室内FTIR测量数据上的大量实验表明,HAIR在去噪、补全、光谱校准与超分辨率任务中持续优于现有最优方法,建立了客观精度与视觉质量的新基准。
原文摘要 · Abstract (English)
Thermal-infrared (TIR) hyperspectral imagery (HSI) provides critical scene information for various applications. However, its practical utility is severely limited by unique sensor degradations beyond the capabilities of existing restoration methods, which are ignorant of underlying thermal physics. Here, we propose HAIR (HADAR-based Image Restoration) as a physics-driven framework for ground-based TIR-HSI restoration. HAIR utilizes the HADAR rendering equation (HRE) and combines it with the atmospheric downwelling radiative transfer equation (RTE) to model TIR-HSI using temperature, emissivity, and texture (TeX) physical triplets. This physical model leads to a TeX decompose-synthesize strategy that guarantees physical consistency and spatio-spectral noise resilience, in stark contrast to existing approaches. Moreover, our framework uses a forward-modeled atmospheric downwelling reference, along with spectral smoothness of emissivity and blackbody radiation, to enable spectral calibration and generation that would otherwise be elusive. Our extensive experiments on the outdoor DARPA Invisible Headlights dataset and in-lab FTIR measurements show that HAIR consistently outperforms state-of-the-art methods across denoising, inpainting, spectral calibration, and spectral super-resolution, establishing a benchmark in objective accuracy and visual quality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。