YOLOv8微调到水果检测,性能提升却几乎不丢通用能力
Fine-Tuning Without Forgetting: Adaptation of YOLOv8 Preserves COCO Performance
- 逐步解冻骨干网络深层,探索不同微调深度的影响
- 深层微调使水果检测mAP50提升10个百分点,仍保持COCO性能稳定
- 适合追求高精度细粒度识别的场景,无需担心通用性下降
大型预训练目标检测器的成功依赖于其在下游任务中的适应能力。尽管微调是标准方法,但在挑战性的细粒度领域中,需谨慎考虑特征粒度。核心问题在于:为优化特定任务,应将预训练骨干网络微调到何种深度,以避免对原始通用能力的灾难性遗忘?为此,我们系统地评估了微调深度的影响。将标准YOLOv8n模型适配至定制细粒度水果检测数据集,通过逐步解冻骨干层(冻结点位于第22、15、10层)进行训练。性能在目标水果数据集和原COCO验证集上均通过双头评估架构进行严格测试。结果明确显示,更深层微调(解冻至第10层)相比仅训练头部,在细粒度水果任务上带来显著性能提升(如绝对mAP50提升+10%)。令人惊讶的是,这种显著的专化并未导致COCO基准性能明显下降(所有测试冻结级别下绝对mAP差异<0.1%)。结论表明,调整中-晚期骨干特征对细粒度专化极为有效;关键在于,这种适应可实现而无需付出通常预期的灾难性遗忘代价,强烈支持在复杂领域或追求极致专用性能时探索更深微调策略。
原文摘要 · Abstract (English)
The success of large pre-trained object detectors hinges on their adaptability to diverse downstream tasks. While fine-tuning is the standard adaptation method, specializing these models for challenging fine-grained domains necessitates careful consideration of feature granularity. The critical question remains: how deeply should the pre-trained backbone be fine-tuned to optimize for the specialized task without incurring catastrophic forgetting of the original general capabilities? Addressing this, we present a systematic empirical study evaluating the impact of fine-tuning depth. We adapt a standard YOLOv8n model to a custom, fine-grained fruit detection dataset by progressively unfreezing backbone layers (freeze points at layers 22, 15, and 10) and training. Performance was rigorously evaluated on both the target fruit dataset and, using a dual-head evaluation architecture, on the original COCO validation set. Our results demonstrate unequivocally that deeper fine-tuning (unfreezing down to layer 10) yields substantial performance gains (e.g., +10\% absolute mAP50) on the fine-grained fruit task compared to only training the head. Strikingly, this significant adaptation and specialization resulted in negligible performance degradation (<0.1\% absolute mAP difference) on the COCO benchmark across all tested freeze levels. We conclude that adapting mid-to-late backbone features is highly effective for fine-grained specialization. Critically, our results demonstrate this adaptation can be achieved without the commonly expected penalty of catastrophic forgetting, presenting a compelling case for exploring deeper fine-tuning strategies, particularly when targeting complex domains or when maximizing specialized performance is paramount.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。