对比了自监督学习在真实世界小目标检测中的效果,指导如何选策略。
Self-Supervised Learning for Real-World Object Detection: a Survey
- 按实例判别和掩码图像建模分类,比较不同方法适配性。
- 在COCO和红外车辆数据集上验证,小目标检测性能显著提升。
- 适合做小目标检测、有定制数据的开发者参考使用。
自监督学习(SSL)在计算机视觉中展现出巨大潜力,使网络能够从大规模无标签数据中学习有意义的表征。主流方法分为实例判别和掩码图像建模(MIM)两类。尽管实例判别是SSL基础,但其最初针对分类设计,对小目标检测效果有限。本文聚焦面向真实世界物体检测的SSL方法,特别关注复杂环境中小物体的检测。不同于以往综述,本研究详细对比了基于对象的实例判别与MIM方法,并评估其在CNN与ViT架构下的表现。实验基于广泛使用的COCO数据集及专注于红外遥感影像车辆检测的专用数据集进行。同时分析了在自定义领域数据集上预训练的影响,揭示某些SSL策略更适用于未清洗数据。结果表明:实例判别适合基于CNN的编码器,而MIM更适合基于ViT的架构和自定义数据预训练。本综述为选择最优SSL策略提供了实用指南,综合考虑主干架构、目标尺寸与定制预训练需求。最终证明,合理选择预训练策略与编码器可显著提升真实场景下小目标检测性能,尤其在资源受限场景中。
原文摘要 · Abstract (English)
Self-Supervised Learning (SSL) has emerged as a promising approach in computer vision, enabling networks to learn meaningful representations from large unlabeled datasets. SSL methods fall into two main categories: instance discrimination and Masked Image Modeling (MIM). While instance discrimination is fundamental to SSL, it was originally designed for classification and may be less effective for object detection, particularly for small objects. In this survey, we focus on SSL methods specifically tailored for real-world object detection, with an emphasis on detecting small objects in complex environments. Unlike previous surveys, we offer a detailed comparison of SSL strategies, including object-level instance discrimination and MIM methods, and assess their effectiveness for small object detection using both CNN and ViT-based architectures. Specifically, our benchmark is performed on the widely-used COCO dataset, as well as on a specialized real-world dataset focused on vehicle detection in infrared remote sensing imagery. We also assess the impact of pre-training on custom domain-specific datasets, highlighting how certain SSL strategies are better suited for handling uncurated data. Our findings highlight that instance discrimination methods perform well with CNN-based encoders, while MIM methods are better suited for ViT-based architectures and custom dataset pre-training. This survey provides a practical guide for selecting optimal SSL strategies, taking into account factors such as backbone architecture, object size, and custom pre-training requirements. Ultimately, we show that choosing an appropriate SSL pre-training strategy, along with a suitable encoder, significantly enhances performance in real-world object detection, particularly for small object detection in frugal settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。