基于视觉对比学习的YOLO域适应检测器,提升跨域检测性能。
CLDA-YOLO: Visual Contrastive Learning Based Domain Adaptive YOLO Detector
- 采用师生协作框架,结合不确定性学习与动态数据增强。
- 在多个域适应数据集上实现领先性能,推理速度无损耗。
- 适用于单阶段检测器,解决跨域时特征对齐难题。
无监督域自适应(UDA)算法可在域偏移条件下显著提升目标检测器性能,减少对大量标注数据和重训练的需求。当前主流域自适应检测算法多针对两阶段检测器,直接应用于单阶段检测器如YOLO时效果有限。为使YOLO受益于UDA,本文构建了基于师生协作系统的完整域自适应架构。提出不确定性学习以应对教师模型生成的高不确定性伪标签,并引入动态数据增强,渐进式适应师生系统。针对单阶段检测器难以在多阶段对齐的问题,采用统一的视觉对比学习范式,在主干网络和检测头分别对实例进行对齐,有效提升检测器在跨域任务中的鲁棒性。最终提出的CLDA-YOLO是一种基于视觉对比学习的无监督域自适应YOLO检测器,在多个域自适应数据集上取得高度竞争力的结果,且推理速度未下降。
原文摘要 · Abstract (English)
Unsupervised domain adaptive (UDA) algorithms can markedly enhance the performance of object detectors under conditions of domain shifts, thereby reducing the necessity for extensive labeling and retraining. Current domain adaptive object detection algorithms primarily cater to two-stage detectors, which tend to offer minimal improvements when directly applied to single-stage detectors such as YOLO. Intending to benefit the YOLO detector from UDA, we build a comprehensive domain adaptive architecture using a teacher-student cooperative system for the YOLO detector. In this process, we propose uncertainty learning to cope with pseudo-labeling generated by the teacher model with extreme uncertainty and leverage dynamic data augmentation to asymptotically adapt the teacher-student system to the environment. To address the inability of single-stage object detectors to align at multiple stages, we utilize a unified visual contrastive learning paradigm that aligns instance at backbone and head respectively, which steadily improves the robustness of the detectors in cross-domain tasks. In summary, we present an unsupervised domain adaptive YOLO detector based on visual contrastive learning (CLDA-YOLO), which achieves highly competitive results across multiple domain adaptive datasets without any reduction in inference speed.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。