arXiv:2507.12157cs.CV2025-07

不依赖预训练模型,从零开始实现高精度细粒度图像识别

Fine-Grained Image Recognition from Scratch with Teacher-Guided Data Augmentation

  • 用教师指导的数据增强框架,结合弱监督知识蒸馏训练
  • 低分辨率下准确率提升23%,参数量减少20.6倍,训练数据大幅降低
  • 适合资源受限场景,可定制轻量级专用模型

细粒度图像识别(FGIR)旨在区分同一类别中视觉相似的子类,如鸟类物种识别。现有方法大多依赖ImageNet等大规模数据集预训练的主干网络,限制了在资源受限环境中的适应性,并阻碍了针对FGIR独特挑战设计任务特定架构。本文挑战这一惯例,证明高性能的FGIR系统可完全从零训练。提出TGDA框架,通过细粒度感知的教师模型实现知识蒸馏,融合数据感知增强与弱监督。该框架支持设计任务特定、硬件友好的架构,包括用于低分辨率FGIR的LRNets和高效推理优化的ViTFS系列视觉变换器。在三个FGIR基准上,多种分辨率设置下的实验表明,本方法持续达到或超越现有预训练模型性能。尤其在低分辨率场景下,使用TGDA训练的LRNets相比先前方法准确率提升最高达23%,参数量最多减少20.6倍,计算量与训练数据需求显著降低。同样,ViTFS-T在仅使用15.3倍更少可训练参数的情况下,性能媲美ImageNet-21k预训练的ViT B-16,且所需数据量级更低。这些结果凸显TGDA作为预训练替代方案的潜力,推动更高效的细粒度视觉系统发展。

原文摘要 · Abstract (English)

Fine-grained image recognition (FGIR) aims to distinguish visually similar sub-categories within a broader class, such as identifying bird species. While most existing FGIR methods rely on backbones pretrained on large-scale datasets like ImageNet, this dependence limits adaptability to resource-constrained environments and hinders the development of task-specific architectures tailored to the unique challenges of FGIR. In this work, we challenge the conventional reliance on pretrained models by demonstrating that high-performance FGIR systems can be trained entirely from scratch. We introduce a novel training framework, TGDA, that integrates data-aware augmentation with weak supervision via a fine-grained-aware teacher model, implemented through knowledge distillation. This framework unlocks the design of task-specific and hardware-aware architectures, including LRNets for low-resolution FGIR and ViTFS, a family of Vision Transformers optimized for efficient inference. Extensive experiments across three FGIR benchmarks over diverse settings involving low-resolution and high-resolution inputs show that our method consistently matches or surpasses state-of-the-art pretrained counterparts. In particular, in the low-resolution setting, LRNets trained with TGDA improve accuracy by up to 23\% over prior methods while requiring up to 20.6x less parameters, lower FLOPs, and significantly less training data. Similarly, ViTFS-T can match the performance of a ViT B-16 pretrained on ImageNet-21k while using 15.3x fewer trainable parameters and requiring orders of magnitudes less data. These results highlight TGDA's potential as an adaptable alternative to pretraining, paving the way for more efficient fine-grained vision systems.

细粒度识别知识蒸馏轻量化模型从零训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。