用纯合成数据训练无人机检测模型,实测效果接近真实数据训练结果。
Drone Detection using Deep Neural Networks Trained on Pure Synthetic Data
- 纯合成数据训练Faster-RCNN检测模型
- 在真实数据集MAV-Vid上达AP_50 97.0%
- 适合低资源场景下的无人机检测应用
无人机检测受益于深度神经网络的发展,但与许多应用一样,受限于高质量标注数据的获取。合成数据可低成本生成,提升数据可用性与质量。然而,基于合成数据训练的模型需验证其在真实世界中的表现,即“仿真到现实”的迁移能力问题。本文提出一个完全基于合成数据训练的无人机检测Faster-RCNN模型,并在真实数据集MAV-Vid上评估,获得AP_50 97.0%,与同等规模真实数据训练模型(97.8%)性能接近。结果表明,合成数据可用于降低数据采集成本并提升标注质量,为更复杂的合成无人机数据集提供基础。例如,针对机场等关键场景的高保真模拟可降低安全敏感应用的数据生成风险。此外,合成数据有望推动可靠无人机检测系统建设,服务于无人交通管理系统等领域。代码与数据集已公开于GitHub与HuggingFace。
原文摘要 · Abstract (English)
Drone detection has benefited from improvements in deep neural networks, but like many other applications, suffers from the availability of accurate data for training. Synthetic data provides a potential for low-cost data generation and has been shown to improve data availability and quality. However, models trained on synthetic datasets need to prove their ability to perform on real-world data, known as the problem of sim-to-real transferability. Here, we present a drone detection Faster-RCNN model trained on a purely synthetic dataset that transfers to real-world data. We found that it achieves an AP_50 of 97.0% when evaluated on the MAV-Vid - a real dataset of flying drones - compared with 97.8% for an equivalent model trained on real-world data. Our results show that using synthetic data for drone detection has the potential to reduce data collection costs and improve labelling quality. These findings could be a starting point for more elaborate synthetic drone datasets. For example, realistic recreations of specific scenarios could de-risk the dataset generation of safety-critical applications such as the detection of drones at airports. Further, synthetic data may enable reliable drone detection systems, which could benefit other areas, such as unmanned traffic management systems. The code is available https://github.com/mazqtpopx/cranfield-synthetic-drone-detection alongside the datasets https://huggingface.co/datasets/mazqtpopx/cranfield-synthetic-drone-detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。