arXiv:2411.15497cs.CV2024-11CVPR被引 69

用扩散模型生成高质量遥感目标检测数据,提升小样本检测效果。

AeroGen: Enhancing Remote Sensing Object Detection with Diffusion-Driven Data Generation

  • 设计可控制布局的扩散生成模型,支持水平与旋转框条件生成。
  • 合成数据使DIOR、DIOR-R、HRSC上检测精度分别提升3.7%、4.3%、2.43%。
  • 适合遥感目标检测数据稀缺场景,尤其对罕见类别有显著帮助。

遥感图像目标检测(RSIOD)旨在识别和定位卫星或航空影像中的特定物体。然而,当前的RSIOD数据集存在标注数据严重不足的问题,显著制约了检测算法的性能。尽管现有技术如数据增强和半监督学习可在一定程度上缓解这一问题,但它们仍高度依赖高质量标注数据,且在稀有物体类别上表现较差。为此,本文提出一种面向RSIOD的布局可控扩散生成模型(AeroGen)。据我们所知,AeroGen是首个同时支持水平与旋转边界框条件生成的模型,能够生成符合特定布局和物体类别要求的高质量合成图像。此外,我们设计了一个端到端的数据增强框架,集成多样性条件生成器与过滤机制,以提升生成数据的多样性和质量。实验结果表明,所生成的合成数据具有高质量和多样性。更重要的是,这些合成数据能显著提升现有RSIOD模型的检测性能,在DIOR、DIOR-R和HRSC数据集上的mAP分别提升3.7%、4.3%和2.43%。代码已公开于https://github.com/Sonettoo/AeroGen。

原文摘要 · Abstract (English)

Remote sensing image object detection (RSIOD) aims to identify and locate specific objects within satellite or aerial imagery. However, there is a scarcity of labeled data in current RSIOD datasets, which significantly limits the performance of current detection algorithms. Although existing techniques, e.g., data augmentation and semi-supervised learning, can mitigate this scarcity issue to some extent, they are heavily dependent on high-quality labeled data and perform worse in rare object classes. To address this issue, this paper proposes a layout-controllable diffusion generative model (i.e. AeroGen) tailored for RSIOD. To our knowledge, AeroGen is the first model to simultaneously support horizontal and rotated bounding box condition generation, thus enabling the generation of high-quality synthetic images that meet specific layout and object category requirements. Additionally, we propose an end-to-end data augmentation framework that integrates a diversity-conditioned generator and a filtering mechanism to enhance both the diversity and quality of generated data. Experimental results demonstrate that the synthetic data produced by our method are of high quality and diversity. Furthermore, the synthetic RSIOD data can significantly improve the detection performance of existing RSIOD models, i.e., the mAP metrics on DIOR, DIOR-R, and HRSC datasets are improved by 3.7%, 4.3%, and 2.43%, respectively. The code is available at https://github.com/Sonettoo/AeroGen.

遥感检测扩散模型数据生成小样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。