YOLO训练时可跳过已学好的图片,提速超1.4倍且更准。
Does YOLO Really Need to See Every Training Image in Every Epoch?
- 按学习充分度动态分类图片,分层采样减少冗余。
- 在COCO、DOTA等数据集上提速1.43倍以上,精度不降反升。
- 适合追求训练效率的工业部署与资源受限场景。
YOLO检测器以推理速度快著称,但训练耗时异常,因其每轮迭代都处理所有训练图像,即使许多图像已充分学习。这与“一次看遍”的理念相悖。本文提出抗遗忘采样策略(AFSS),动态决定每轮哪些图像需保留、哪些可跳过。AFSS通过检测召回率与精确率最小值衡量每张图的学习充分度,将其分为易、中、难三类:易图稀疏重采样,优先选久未使用图像以避免遗忘;中图部分采样,优先近期未用者,其余随机补全以保覆盖;难图全量采样确保充分学习。学习充分度定期更新,使模型逐步聚焦有效图像。在MS COCO 2017、PASCAL VOC 2007、DOTA-v1.0和DIOR-R等数据集上,该方法为YOLO系列带来超过1.43倍的训练加速,同时提升准确率。
原文摘要 · Abstract (English)
YOLO detectors are known for their fast inference speed, yet training them remains unexpectedly time-consuming due to their exhaustive pipeline that processes every training image in every epoch, even when many images have already been sufficiently learned. This stands in clear contrast to the efficiency suggested by the ``You Only Look Once'' philosophy. This naturally raises an important question: \textit{Does YOLO really need to see every training image in every epoch?} To explore this, we propose an Anti-Forgetting Sampling Strategy (AFSS) that dynamically determines which images should be used and which can be skipped during each epoch, allowing the detector to learn more effectively and efficiently. Specifically, AFSS measures the learning sufficiency of each training image as the minimum of its detection recall and precision, and dynamically categorizes training images into easy, medium, or hard levels accordingly. Easy training images are sparsely resampled during training in a continuous review manner, with priority given to those that have not been used for a long time to reduce redundancy and prevent forgetting. Moderate training images are partially selected, prioritizing recently unused ones and randomly choosing the rest from unselected images to ensure coverage and prevent forgetting. Hard training images are fully sampled in every epoch to ensure sufficient learning. The learning sufficiency of each training image is periodically updated, enabling detectors to adaptively shift its focus toward the informative training images over time while progressively discarding redundant ones. On widely used natural image detection benchmarks (MS COCO 2017 and PASCAL VOC 2007) and remote sensing detection datasets (DOTA-v1.0 and DIOR-R), AFSS achieves more than $1.43\times$ training speedup for YOLO-series detectors while also improving accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。