让模型推理时自我学习,突破细粒度分类难题
Progressively Exploring and Exploiting Inference Data to Break Fine-Grained Classification Barrier
- 模型在推理阶段逐步探索并利用免费数据优化分类器
- 在多个数据集上实现显著性能提升,克服标注难与语义变问题
- 适合真实场景中动态变化的细粒度分类任务
当前细粒度分类研究主要聚焦于特征学习,但在实际应用中,细粒度数据标注困难,特征与语义高度多样且频繁变化,导致传统实验设置与真实场景之间存在固有障碍,限制了现有方法的有效性。尽管部分研究提出潜在解决方案,但大多仍依赖有限监督信息,难以提供有效应对。本文基于理论分析,提出一种新型学习范式,使模型在推理过程中逐步学习,从而利用推理时的无成本数据更准确地表征细粒度类别,并适应动态语义变化。在此基础上,设计了一种高效的探索与利用策略(EXP2),根据类别表示探索有用推理样本,并用于优化分类器。实验结果验证了该方法的通用有效性,为未来深入理解与探索真实世界中的细粒度分类提供了指导。
原文摘要 · Abstract (English)
Current fine-grained classification research primarily focuses on fine-grained feature learning. However, in real-world scenarios, fine-grained data annotation is challenging, and the features and semantics are highly diverse and frequently changing. These issues create inherent barriers between traditional experimental settings and real-world applications, limiting the effectiveness of conventional fine-grained classification methods. Although some recent studies have provided potential solutions to these issues, most of them still rely on limited supervised information and thus fail to offer effective solutions. In this paper, based on theoretical analysis, we propose a novel learning paradigm to break the barriers in fine-grained classification. This paradigm enables the model to progressively learn during inference, thereby leveraging cost-free data at inference time to more accurately represent fine-grained categories and adapt to dynamic semantic changes. On this basis, an efficient EXPloring and EXPloiting strategy and method (EXP2) is designed. Thereinto, useful inference data samples are explored according to class representations and exploited to optimize classifiers. Experimental results demonstrate the general effectiveness of our method, providing guidance for future in-depth understanding and exploration of real-world fine-grained classification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。