arXiv:2603.08075cs.CV2026-03中稿 · CVPR被引 3

让模型在识别旧类别时实时发现新类别,避免分类混乱。

TALON: Test-time Adaptive Learning for On-the-Fly Category Discovery

  • 测试时动态更新类别原型和编码器参数,实现在线学习。
  • 新类别识别准确率提升显著,且有效防止类别爆炸问题。
  • 适合需要持续学习新类别的实际应用场景,如监控、推荐。

在线流式类别发现(OCD)旨在仅用标注数据训练的模型基础上,从无标签在线数据流中同时识别已知类别并发现新类别。现有方法冻结离线训练的特征提取器,采用基于哈希的框架将特征量化为二进制码作为类别原型。但固定的知识库无法利用新数据的学习潜力,且特征量化造成信息损失、表达能力下降,加剧类内差异,常引发类别爆炸(单类分裂为多个伪类)。为此,我们提出测试时自适应学习框架TALON,包含语义感知原型更新与稳定测试时编码器更新两种互补策略:前者动态优化类别原型以增强分类性能,后者直接将新信息融入参数空间。二者协同使模型能持续扩展知识库。此外,我们在离线阶段引入边际感知逻辑校准,扩大类间间距,增强类内紧凑性,为未来类别发现预留嵌入空间。在标准OCD基准上的实验表明,本方法显著优于现有哈希基最先进方法,在新类别识别准确率上提升明显,并有效缓解类别爆炸问题。代码已公开于https://github.com/ynanwu/TALON。

原文摘要 · Abstract (English)

On-the-fly category discovery (OCD) aims to recognize known categories while simultaneously discovering novel ones from an unlabeled online stream, using a model trained only on labeled data. Existing approaches freeze the feature extractor trained offline and employ a hash-based framework that quantizes features into binary codes as class prototypes. However, discovering novel categories with a fixed knowledge base is counterintuitive, as the learning potential of incoming data is entirely neglected. In addition, feature quantization introduces information loss, diminishes representational expressiveness, and amplifies intra-class variance. It often results in category explosion, where a single class is fragmented into multiple pseudo-classes. To overcome these limitations, we propose a test-time adaptation framework that enables learning through discovery. It incorporates two complementary strategies: a semantic-aware prototype update and a stable test-time encoder update. The former dynamically refines class prototypes to enhance classification, whereas the latter integrates new information directly into the parameter space. Together, these components allow the model to continuously expand its knowledge base with newly encountered samples. Furthermore, we introduce a margin-aware logit calibration in the offline stage to enlarge inter-class margins and improve intra-class compactness, thereby reserving embedding space for future class discovery. Experiments on standard OCD benchmarks demonstrate that our method substantially outperforms existing hash-based state-of-the-art approaches, yielding notable improvements in novel-class accuracy and effectively mitigating category explosion. The code is publicly available at \textcolor{blue}{https://github.com/ynanwu/TALON}.

在线学习类别发现测试时适应动态学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。