提出渐进式提示融合网络,提升红外图像多退化场景增强效果。
Enhancing Infrared Vision: Progressive Prompt Fusion Network and Benchmark

- 基于热成像原理构建提示对,分步融合引导模型修复不同退化。
- 在复杂退化场景下实现8.76%性能提升,有效降噪并增强对比度。
- 适用于需要多退化协同处理的红外视觉任务,如安防与夜视。
我们关注相对未被充分研究的热红外图像增强任务。现有方法多针对单一退化(如噪声、对比度低、模糊),难以应对耦合退化;而通用的全量增强方法因成像机制差异,在红外图像上表现有限。为此,我们重新审视热成像机理,提出渐进式提示融合网络(PPFN)。该网络首先根据热成像过程建立提示对,针对每类退化融合对应提示对,调制模型特征以提供自适应引导,实现单退化或多退化条件下的精准修复。同时引入选择性渐进训练(SPT)机制,逐步优化复合退化场景的处理能力,使模型既能消除相机噪声,保留关键结构细节,又能显著提升整体对比度。此外,我们构建了当前最高质量、覆盖多场景的红外图像基准数据集。大量实验表明,本方法不仅在特定退化下取得良好视觉效果,更在复杂退化场景中实现8.76%的显著性能提升。代码已公开于https://github.com/Zihang-Chen/HM-TIR。
原文摘要 · Abstract (English)
We engage in the relatively underexplored task named thermal infrared image enhancement. Existing infrared image enhancement methods primarily focus on tackling individual degradations, such as noise, contrast, and blurring, making it difficult to handle coupled degradations. Meanwhile, all-in-one enhancement methods, commonly applied to RGB sensors, often demonstrate limited effectiveness due to the significant differences in imaging models. In sight of this, we first revisit the imaging mechanism and introduce a Progressive Prompt Fusion Network (PPFN). Specifically, the PPFN initially establishes prompt pairs based on the thermal imaging process. For each type of degradation, we fuse the corresponding prompt pairs to modulate the model's features, providing adaptive guidance that enables the model to better address specific degradations under single or multiple conditions. In addition, a Selective Progressive Training (SPT) mechanism is introduced to gradually refine the model's handling of composite cases to align the enhancement process, which not only allows the model to remove camera noise and retain key structural details, but also enhancing the overall contrast of the thermal image. Furthermore, we introduce the most high-quality, multi-scenarios infrared benchmark covering a wide range of scenarios. Extensive experiments substantiate that our approach not only delivers promising visual results under specific degradation but also significantly improves performance on complex degradation scenes, achieving a notable 8.76\% improvement. Code is available at https://github.com/Zihang-Chen/HM-TIR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。