arXiv:2506.05872cs.CV2025-06NeurIPS被引 19

用检索生成背景,让少样本目标检测在跨域时更准。

Domain-RAG: Retrieval-Guided Compositional Image Generation for Cross-Domain Few-Shot Object Detection

  • 从相似图像中检索背景,生成与目标域一致的新场景
  • 无需训练,生成图像在多个跨域任务上显著提升检测性能
  • 适合做少样本跨域目标检测的研究者和工程师

跨域少样本目标检测(CD-FSOD)旨在仅用极少量来自新领域的标注样本检测新物体。尽管数据增强和生成方法在少样本学习中展现潜力,但其在CD-FSOD中的有效性仍不明确,因需兼顾视觉真实性和域一致性。现有方法如复制粘贴增强和文本生成图像常无法保持正确类别或生成与目标域一致的背景,难以直接应用。为此,我们提出Domain-RAG,一种无需训练、基于检索引导的组合式图像生成框架,专为CD-FSOD设计。该框架包含三个阶段:域感知背景检索、域引导背景生成与前景-背景组合。输入图像先分解为前景与背景;随后检索语义与风格相似图像,指导生成模型在原图与检索上下文条件下合成新背景;最后将保留的前景与新生成的域对齐背景组合成生成图像。无需额外监督或训练,Domain-RAG在多种任务中均生成高质量、域一致的样本,包括CD-FSOD、遥感少样本检测与伪装目标检测。大量实验显示其优于强基线,建立新基准。代码将在录用后发布。

原文摘要 · Abstract (English)

Cross-Domain Few-Shot Object Detection (CD-FSOD) aims to detect novel objects with only a handful of labeled samples from previously unseen domains. While data augmentation and generative methods have shown promise in few-shot learning, their effectiveness for CD-FSOD remains unclear due to the need for both visual realism and domain alignment. Existing strategies, such as copy-paste augmentation and text-to-image generation, often fail to preserve the correct object category or produce backgrounds coherent with the target domain, making them non-trivial to apply directly to CD-FSOD. To address these challenges, we propose Domain-RAG, a training-free, retrieval-guided compositional image generation framework tailored for CD-FSOD. Domain-RAG consists of three stages: domain-aware background retrieval, domain-guided background generation, and foreground-background composition. Specifically, the input image is first decomposed into foreground and background regions. We then retrieve semantically and stylistically similar images to guide a generative model in synthesizing a new background, conditioned on both the original and retrieved contexts. Finally, the preserved foreground is composed with the newly generated domain-aligned background to form the generated image. Without requiring any additional supervision or training, Domain-RAG produces high-quality, domain-consistent samples across diverse tasks, including CD-FSOD, remote sensing FSOD, and camouflaged FSOD. Extensive experiments show consistent improvements over strong baselines and establish new state-of-the-art results. Codes will be released upon acceptance.

少样本检测图像生成跨域泛化RAG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。