arXiv:2509.05490cs.CVcs.AI2025-09被引 11

分析YOLO模型冻结策略,帮你在资源受限时高效迁移学习。

An Analysis of Layer-Freezing Strategies for Enhanced Transfer Learning in YOLO Architectures

  • 系统测试不同冻结深度对YOLOv8/v10的影响。
  • 冻结策略可省28%显存,部分场景精度还更高。
  • 根据数据特点选策略:抗类别不均衡用浅冻结。

YOLO架构在实时目标检测中至关重要,但在无人机等资源受限场景中部署需高效迁移学习。尽管层冻结是常用方法,但其对现代YOLOv8和YOLOv10架构的具体影响——尤其是冻结深度、数据特性与训练动态之间的相互作用——仍不清楚。本研究通过系统分析四种挑战性数据集上的多种冻结配置,填补了这一空白。方法结合梯度行为分析(L2范数)与可视化解释(Grad-CAM),深入揭示不同冻结策略下的训练动态。结果表明,不存在通用最优策略,而是取决于数据属性:冻结主干网络有助于保留通用特征,而较浅冻结更适应极端类别不平衡。这些配置相比全微调可降低高达28%的GPU内存消耗,并在某些情况下实现超过全微调的平均精度(mAP@50)。梯度分析验证了适度冻结模型的独特收敛模式。研究提供实证结论与实用指南,为有限资源下的目标检测迁移学习提供基于证据的平衡方案。

原文摘要 · Abstract (English)

The You Only Look Once (YOLO) architecture is crucial for real-time object detection. However, deploying it in resource-constrained environments such as unmanned aerial vehicles (UAVs) requires efficient transfer learning. Although layer freezing is a common technique, the specific impact of various freezing configurations on contemporary YOLOv8 and YOLOv10 architectures remains unexplored, particularly with regard to the interplay between freezing depth, dataset characteristics, and training dynamics. This research addresses this gap by presenting a detailed analysis of layer-freezing strategies. We systematically investigate multiple freezing configurations across YOLOv8 and YOLOv10 variants using four challenging datasets that represent critical infrastructure monitoring. Our methodology integrates a gradient behavior analysis (L2 norm) and visual explanations (Grad-CAM) to provide deeper insights into training dynamics under different freezing strategies. Our results reveal that there is no universal optimal freezing strategy but, rather, one that depends on the properties of the data. For example, freezing the backbone is effective for preserving general-purpose features, while a shallower freeze is better suited to handling extreme class imbalance. These configurations reduce graphics processing unit (GPU) memory consumption by up to 28% compared to full fine-tuning and, in some cases, achieve mean average precision (mAP@50) scores that surpass those of full fine-tuning. Gradient analysis corroborates these findings, showing distinct convergence patterns for moderately frozen models. Ultimately, this work provides empirical findings and practical guidelines for selecting freezing strategies. It offers a practical, evidence-based approach to balanced transfer learning for object detection in scenarios with limited resources.

YOLO迁移学习冻结策略轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。