用少量实拍图生成军事车辆图像,提升低数据下的检测效果
Class-specific diffusion models improve military object detection in a low-data domain

- 针对每类军用车辆训练专属扩散模型,用8~24张真图生成合成数据
- 仅用8张真图时,检测精度提升最高达8.0% mAP₅₀
- 加入结构引导可更好控制视角,尤其在数据极少时优势明显
基于扩散的图像生成已成为AI目标检测与分类任务中合成训练数据的有力手段。本文研究在低数据条件下,利用扩散模型生成的图像能否提升军用车辆检测性能。我们仅用每类15种车辆中8或24张真实图像,通过LoRA微调文本到图像扩散模型FLUX.1 [dev],构建类特定扩散模型,并自动生成文本提示生成新样本。相同真实图像用于微调RF-DETR检测器完成15类目标检测任务。随后,使用扩散模型生成的合成数据进一步优化检测器性能。重要的是,无需额外真实数据,生成模型复用有限训练样本。结果表明,FLUX生成图像在低数据场景下显著提升检测性能(8张真图时,mAP₅₀最高提升8.0%)。为解决文本提示驱动扩散的几何控制不足问题,我们引入ControlNet结合边缘图条件生成结构引导数据,构建了FLUX-ControlNet(FLUX-CN)数据集,实现对视角和姿态的显式控制。在数据稀缺时,结构引导进一步提升性能(8张真图时再增4.1% mAP₅₀),但当真实数据增多时无额外收益。该研究证明,对象特定扩散模型能有效提升低数据域中的军用车辆检测能力,且结构引导在极低数据情况下尤为关键。这表明生成图像数据可作为传统仿真流程的替代方案,用于军事AI系统的训练。
原文摘要 · Abstract (English)
Diffusion-based image synthesis has emerged as a promising source of synthetic training data for AI-based object detection and classification. In this work, we investigate whether images generated with diffusion can improve military vehicle detection under low-data conditions. We fine-tuned the text-to-image diffusion model FLUX.1 [dev] using LoRA with only 8 or 24 real images per class across 15 vehicle categories, resulting in class-specific diffusion models, which were used to generate new samples from automatically generated text prompts. The same real images were used to fine-tune the RF-DETR detector for a 15-class object detection task. Synthetic datasets generated by the diffusion models were then used to further improve detector performance. Importantly, no additional real data was required, as the generative models leveraged the same limited training samples. FLUX-generated images improved detection performance, particularly in the low-data regime (up to +8.0% mAP$_{50}$ with 8 real samples). To address the limited geometric control of text prompt-based diffusion, we additionally generated structurally guided synthetic data using ControlNet with Canny edge-map conditioning, yielding a FLUX-ControlNet (FLUX-CN) dataset with explicit control over viewpoint and pose. Structural guidance further enhanced performance when data is scarce (+4.1% mAP$_{50}$ with 8 real samples), but no additional benefit was observed when more real data is available. This study demonstrates that object-specific diffusion models are effective for improving military object detection in a low-data domain, and that structural guidance is most beneficial when real data is highly limited. These results highlight generative image data as an alternative to traditional simulation pipelines for the training of military AI systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。