arXiv:2508.21712cs.CV2025-08被引 2

用轻量微调生成高质量合成数据,小数据下检测性能超越主流方法。

FLORA: Efficient Synthetic Data Generation for Object Detection in Low-Data Regimes via finetuning Flux LoRA

  • 仅用LoRA微调扩散模型,大幅降低算力需求。
  • 500张合成图效果超基线5000张,mAP提升21.3%。
  • 适合资源有限但需高效数据增强的实操场景。

基于扩散模型的生成技术在扩充稀缺目标检测数据集方面展现出巨大潜力。然而,现有方法普遍依赖大规模扩散模型的全量微调,需企业级GPU(如NVIDIA V100)和数千张合成图像。为此,本文提出轻量级合成数据生成方案FLORA,基于Flux 1.1 Dev扩散模型,仅通过低秩适配(LoRA)进行微调,显著降低计算开销,可在消费级GPU(如NVIDIA RTX 4090)上完成合成数据生成。我们在七个多样化的目标检测数据集上进行实证评估,结果表明:仅使用500张由本方法生成的合成图像训练的检测器,其性能优于使用5000张合成图像的ODGEN基线,[email protected]:.95最高提升21.3%。该工作证明,以质量和效率为导向的方法可超越盲目生成,仅用10%的数据量与极小计算成本即可实现更优性能,使高级合成数据生成更贴近真实应用。

原文摘要 · Abstract (English)

Recent advances in diffusion-based generative models have demonstrated significant potential in augmenting scarce datasets for object detection tasks. Nevertheless, most recent models rely on resource-intensive full fine-tuning of large-scale diffusion models, requiring enterprise-grade GPUs (e.g., NVIDIA V100) and thousands of synthetic images. To address these limitations, we propose Flux LoRA Augmentation (FLORA), a lightweight synthetic data generation pipeline. Our approach uses the Flux 1.1 Dev diffusion model, fine-tuned exclusively through Low-Rank Adaptation (LoRA). This dramatically reduces computational requirements, enabling synthetic dataset generation with a consumer-grade GPU (e.g., NVIDIA RTX 4090). We empirically evaluate our approach on seven diverse object detection datasets. Our results demonstrate that training object detectors with just 500 synthetic images generated by our approach yields superior detection performance compared to models trained on 5000 synthetic images from the ODGEN baseline, achieving improvements of up to 21.3% in [email protected]:.95. This work demonstrates that it is possible to surpass state-of-the-art performance with far greater efficiency, as FLORA achieves superior results using only 10% of the data and a fraction of the computational cost. This work demonstrates that a quality and efficiency-focused approach is more effective than brute-force generation, making advanced synthetic data creation more practical and accessible for real-world scenarios.

目标检测合成数据LoRA高效生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。