用游戏引擎生成军事目标检测的合成数据,提升真实场景适应能力。
Exploring Syn-to-Real Domain Adaptation for Military Target Detection
- 用Unreal Engine生成逼真的军事目标RGB合成数据
- 仅用目标类别提示就能超越无监督/半监督方法
- 为低成本军事检测提供新数据方案,适合实战应用
目标检测在民用与军事应用中至关重要,尤其在军事指挥与侦察决策中。现有领域自适应方法多局限于自然场景或自动驾驶领域,难以应对军事场景中多样混合环境带来的挑战。尽管合成孔径雷达(SAR)数据具备全天候、远距离、高分辨率等优势,但其采集与处理成本过高。相比之下,传统RGB相机更低成本且处理更快,但缺乏标注的军事目标检测数据集限制了其应用。为此,本文提出使用Unreal Engine生成基于RGB的合成数据,用于跨域军事目标检测。通过在自建合成数据集上训练,并在网络收集的真实军事目标数据集上验证,我们对比了不同监督程度的前沿域适应方法。结果表明,仅需图像中目标类别的少量提示,当前方法性能显著优于无监督或半监督方法。该研究揭示了当前仍需克服的关键挑战。
原文摘要 · Abstract (English)
Object detection is one of the key target tasks of interest in the context of civil and military applications. In particular, the real-world deployment of target detection methods is pivotal in the decision-making process during military command and reconnaissance. However, current domain adaptive object detection algorithms consider adapting one domain to another similar one only within the scope of natural or autonomous driving scenes. Since military domains often deal with a mixed variety of environments, detecting objects from multiple varying target domains poses a greater challenge. Several studies for armored military target detection have made use of synthetic aperture radar (SAR) data due to its robustness to all weather, long range, and high-resolution characteristics. Nevertheless, the costs of SAR data acquisition and processing are still much higher than those of the conventional RGB camera, which is a more affordable alternative with significantly lower data processing time. Furthermore, the lack of military target detection datasets limits the use of such a low-cost approach. To mitigate these issues, we propose to generate RGB-based synthetic data using a photorealistic visual tool, Unreal Engine, for military target detection in a cross-domain setting. To this end, we conducted synthetic-to-real transfer experiments by training our synthetic dataset and validating on our web-collected real military target datasets. We benchmark the state-of-the-art domain adaptation methods distinguished by the degree of supervision on our proposed train-val dataset pair, and find that current methods using minimal hints on the image (e.g., object class) achieve a substantial improvement over unsupervised or semi-supervised DA methods. From these observations, we recognize the current challenges that remain to be overcome.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。