arXiv:2605.17564cs.CV2026-05

用天气数据提升无人机可见光转热成像效果

A Conditional U-Net Pipeline with Pre- and Post-Processing for Aerial RGB-to-Thermal Image Translation

论文配图:A Conditional U-Net Pipeline with Pre- and Post-Processing for Aerial RGB-to-Thermal Image Translation
图 1 · 摘自论文原文
  • 在U-Net瓶颈层加入天气信息,实现条件生成
  • PSNR达14.55,显著优于基线模型
  • 适合需要低成本热成像的遥感应用

成对的可见光-热成像数据在图像融合、目标跟踪和异常检测中表现优异,但其应用受限于配对数据稀少。本文提出一种基于条件U-Net的管道,结合预处理(饱和度增强、对比度提升)与后处理(高斯模糊),并在Pix2Pix GAN框架内引入天气数据作为瓶颈层条件。使用612对图像进行训练,经五折交叉验证后在保留测试集上评估。所提模型取得14.5485的峰值信噪比(PSNR)、0.8095的结构相似性(SSIM)和0.1666的感知图像块相似性(LPIPS),显著优于基础ThermalGen模型(PSNR: 7.56, SSIM: 0.2444, LPIPS: 0.6317)。结果表明,引入环境辅助数据是提升热成像重建精度的关键。

原文摘要 · Abstract (English)

Paired RGB-thermal data has shown significant utility across a range of applications, including image fusion, object tracking, and anomaly detection; however, its broader adoption is constrained by the limited availability of aligned RGB-thermal image pairs. RGB-to-thermal (and vice versa) image translation has emerged as a practical solution to this challenge. Prior approaches including conditional generative adversarial networks (cGANs) such as ThermalGAN and Scalable Interpolant Transformer (SiT)-based architectures such as ThermalGen have demonstrated strong potential for aerial-to-thermal image translation. In this work, we explore alternative architectures that prioritize simplicity while maintaining performance. Specifically, we propose a conditional U-Net that incorporates weather data at the bottleneck layer, complemented by targeted preprocessing and post-processing techniques applied within the Pix2Pix GAN architecture. We utilize a training set of 612 paired RGB and thermal images, and evaluate over 5-fold cross-validation, ultimately testing on a held-out test set. Our conditional U-Net model performed best, with a peak signal-to-noise ratio (PSNR) of 14.5485, structural similarity index measure (SSIM) of 0.8095, and learned perceptual image patch similarity (LPIPS) of 0.1666. These results outperformed the base ThermalGen model, which attained PSNR, SSIM, and LPIPS scores of 7.56, 0.2444, and 0.6317 respectively. We find that while saturation boost and contrast enhancement for preprocessing and Gaussian blur for post-processing provide observable improvements, the incorporation of conditioning data was most effective. Our findings cement the potential of integrating auxiliary metadata into thermal image generation, suggesting that such information can serve as a proxy for environmental conditions critical to accurate thermal reconstruction.

图像翻译遥感条件生成热成像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。