arXiv:2507.04051cs.CV2025-07ICCV被引 9

用生成数据增强细粒度分类,实现动态识别新类别。

Generate, Refine, and Encode: Leveraging Synthesized Novel Samples for On-the-Fly Fine-Grained Category Discovery

  • 通过扩散模型在隐空间插值生成新样本
  • 筛选差异显著的合成图像提升发现能力
  • 适合少样本细粒度场景,提升在线识别精度

本文研究一个实用但具挑战性的任务:在线类别发现(OCD),旨在识别可能属于已知或未知类别的新流数据,仅依赖少量标注数据。现有方法虽致力于挖掘已知类别的可迁移知识,但在细粒度识别中因标注数据/类别稀少而受限。为此,我们提出基于扩散的OCD框架DiffGRE,分三阶段集成生成、精炼与编码。首先在扩散隐空间中通过跨图像插值生成属性组合的新样本;其次采用多样性驱动策略筛选与已知类别差异显著的合成图像用于训练;最后利用半监督领导者编码将合成数据中的额外类别知识注入模型,提升在线推理中对已知和未知类别的发现性能。在六个细粒度数据集上的实验表明,DiffGRE显著优于现有方法。

原文摘要 · Abstract (English)

In this paper, we investigate a practical yet challenging task: On-the-fly Category Discovery (OCD). This task focuses on the online identification of newly arriving stream data that may belong to both known and unknown categories, utilizing the category knowledge from only labeled data. Existing OCD methods are devoted to fully mining transferable knowledge from only labeled data. However, the transferability learned by these methods is limited because the knowledge contained in known categories is often insufficient, especially when few annotated data/categories are available in fine-grained recognition. To mitigate this limitation, we propose a diffusion-based OCD framework, dubbed DiffGRE, which integrates Generation, Refinement, and Encoding in a multi-stage fashion. Specifically, we first design an attribute-composition generation method based on cross-image interpolation in the diffusion latent space to synthesize novel samples. Then, we propose a diversity-driven refinement approach to select the synthesized images that differ from known categories for subsequent OCD model training. Finally, we leverage a semi-supervised leader encoding to inject additional category knowledge contained in synthesized data into the OCD models, which can benefit the discovery of both known and unknown categories during the on-the-fly inference process. Extensive experiments demonstrate the superiority of our DiffGRE over previous methods on six fine-grained datasets.

细粒度识别在线学习生成建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。