用合成数据扩充无人机热成像数据集,提升目标检测性能
Unlocking Thermal Aerial Imaging: Synthetic Enhancement of UAV Datasets
- 通过控制位置尺度方向生成带新物体的合成热成像图
- 在HIT-UAV和MONET数据集上新增无人机与动物类,检测效果优异
- 证明热成像模型优于可见光训练模型,适合应急搜救等场景
无人机热成像在搜救、野生动物监测和应急响应中潜力巨大,尤其在低光或遮挡条件下。但大规模、多样化的热成像航空数据集稀缺,主要因采集成本高、流程复杂。本文提出一种新型过程化管道,从空中视角生成合成热成像图像。方法可将任意物体类别融入现有热背景,精确控制新物体的位置、尺度、朝向,并与背景视点对齐。我们通过引入新类别增强现有数据集:在城市环境中向HIT-UAV数据集添加无人机类,在MONET数据集加入动物类。在目标检测任务评估中,新旧类别均表现良好,验证了扩展至新应用的可行性。对比分析显示,热成像检测器优于可见光训练模型,强调了复现航空视角的重要性。
原文摘要 · Abstract (English)
Thermal imaging from unmanned aerial vehicles (UAVs) holds significant potential for applications in search and rescue, wildlife monitoring, and emergency response, especially under low-light or obscured conditions. However, the scarcity of large-scale, diverse thermal aerial datasets limits the advancement of deep learning models in this domain, primarily due to the high cost and logistical challenges of collecting thermal data. In this work, we introduce a novel procedural pipeline for generating synthetic thermal images from an aerial perspective. Our method integrates arbitrary object classes into existing thermal backgrounds by providing control over the position, scale, and orientation of the new objects, while aligning them with the viewpoints of the background. We enhance existing thermal datasets by introducing new object categories, specifically adding a drone class in urban environments to the HIT-UAV dataset and an animal category to the MONET dataset. In evaluating these datasets for object detection task, we showcase strong performance across both new and existing classes, validating the successful expansion into new applications. Through comparative analysis, we show that thermal detectors outperform their visible-light-trained counterparts and highlight the importance of replicating aerial viewing angles. Project page: https://github.com/larics/thermal_aerial_synthetic.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。