arXiv:2502.18195cs.CV2025-02ICLR被引 11

通过多视角增强提升少样本目标检测性能,显著改善合成样本质量。

Multi-Perspective Data Augmentation for Few-shot Object Detection

  • 引入多视角数据增强框架,分别优化前景间、前景与背景关系。
  • 在PASCAL VOC上相比基线平均提升17.5%的nAP50,关键在硬样本生成。
  • 适合关注少样本检测中数据多样性与生成质量的研究者。

近期少样本目标检测(FSOD)方法聚焦于利用扩散模型生成合成样本,取得显著进展。然而,这类数据集的多样性常受限于对典型和困难样本缺乏感知,尤其在前景与背景关系建模方面。为此,本文提出多视角数据增强(MPAD)框架。针对前景-前景关系,设计基于上下文学习的物体合成(ICOS)并结合边界框调整,提升合成样本的细节与空间信息;受大间隔原则启发,支持样本在定义类别边界中起关键作用,因此提出谐振提示聚合调度器(HPAS),在扩散模型生成过程中每步混合提示嵌入,生成更具挑战性的新类样本;针对前景-背景关系,引入背景提案(BAP)方法,采样典型及困难背景。在多个FSOD基准上的大量实验验证了方法有效性,其在PASCAL VOC上相较基线平均提升17.5%的nAP50。代码已开源。

原文摘要 · Abstract (English)

Recent few-shot object detection (FSOD) methods have focused on augmenting synthetic samples for novel classes, show promising results to the rise of diffusion models. However, the diversity of such datasets is often limited in representativeness because they lack awareness of typical and hard samples, especially in the context of foreground and background relationships. To tackle this issue, we propose a Multi-Perspective Data Augmentation (MPAD) framework. In terms of foreground-foreground relationships, we propose in-context learning for object synthesis (ICOS) with bounding box adjustments to enhance the detail and spatial information of synthetic samples. Inspired by the large margin principle, support samples play a vital role in defining class boundaries. Therefore, we design a Harmonic Prompt Aggregation Scheduler (HPAS) to mix prompt embeddings at each time step of the generation process in diffusion models, producing hard novel samples. For foreground-background relationships, we introduce a Background Proposal method (BAP) to sample typical and hard backgrounds. Extensive experiments on multiple FSOD benchmarks demonstrate the effectiveness of our approach. Our framework significantly outperforms traditional methods, achieving an average increase of $17.5\%$ in nAP50 over the baseline on PASCAL VOC. Code is available at https://github.com/nvakhoa/MPAD.

少样本检测数据增强扩散模型合成样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。