arXiv:2609.02556cs.CV2026-09

用RGB图像生成红外图,提升无人机视角下车辆检测效果。

RGB-to-IR image translation for infrared vehicle detection in unseen UAV domains

论文配图:RGB-to-IR image translation for infrared vehicle detection in unseen UAV domains
图 1 · 摘自论文原文
  • 用生成模型将可见光图像转为红外图像,弥补真实红外数据不足。
  • 在Kust4K和VTUAV数据集上mAP分别提升至60.1和38.4。
  • 适合做跨域无人机红外目标检测的研究者参考。

当真实红外航空影像稀缺时,合成训练数据对视觉AI开发至关重要。尽管无人机可见光(RGB)图像丰富,但难以捕捉发动机热量等热特性,使跨模态映射学习困难。本文研究现代生成式翻译器能否克服这一差距,以提升在未见无人机目标域上的红外车辆检测性能。在配对的RGB-IR源数据集上训练翻译器,将其应用于未见目标域的RGB图像,生成合成红外数据。评估方法包括监督GAN、ControlNet扩散模型及LoRA微调的基础模型。合成红外图像用于训练RF-DETR检测器,在五个航拍数据集上测试,以Kust4K和VTUAV为目标域。合成红外显著优于RGB与灰度基线。采用控制网络的Stable Diffusion 3.5表现最佳,在Kust4K上mAP从50.8升至60.1,在VTUAV上从25.6升至38.4。通过多种子(+1.1 mAP)和提示变化(+3.3 mAP)增加输出多样性,在VTUAV上进一步提升。虽仍落后于真实红外数据,但生成式翻译有效缓解了红外数据稀缺问题,提升了跨域检测性能。

原文摘要 · Abstract (English)

Synthetic training data is crucial for developing vision AI when real-world data is scarce, as in thermal infrared (IR) aerial vehicle detection. While abundant UAV RGB imagery motivates RGB-to-IR translation for data augmentation, unobservable thermal traits (e.g., engine heat) make learning transferable mappings challenging. This work investigates whether modern generative translators can overcome this cross-modal gap to improve infrared vehicle detection on unseen UAV target domains. Translators are trained on paired RGB-IR source datasets and applied to RGB training images from held-out target datasets to generate synthetic IR data. Evaluated methods include supervised GANs, ControlNet-based diffusion models, and foundation-model editing via LoRA. The resulting synthetic IR imagery is used to train RF-DETR vehicle detectors, which are evaluated on unseen IR target test splits across five aerial datasets, with Kust4K and VTUAV serving as target domains. Synthetic IR consistently outperforms RGB and grayscale baselines. Stable Diffusion 3.5 with ControlNet yields the best results, improving mAP from 50.8 to 60.1 on Kust4K and from 25.6 to 38.4 on VTUAV compared to models trained only on source-domain IR data. Increasing output diversity via multiple seeds (+1.1 mAP) and prompt variations (+3.3 mAP) provides additional gains on VTUAV. Although a performance gap to real target IR data remains, generative RGB-to-IR translation effectively mitigates IR data scarcity and improves cross-domain aerial vehicle detection.

图像生成红外检测跨域迁移无人机视觉

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。