无需源数据,用无标签目标数据提升YOLO检测器的跨域性能。
Source-Free Domain Adaptation for YOLO Object Detection
- 基于师生框架,对目标域图像施加自适应增强。
- 在多个基准上表现媲美甚至超过使用源数据的方法。
- 适合部署在隐私敏感或资源受限的真实视觉系统中。
源域自适应(SFDA)是目标检测中的一个挑战性问题,即在不使用源域数据(出于隐私和效率考虑)的情况下,将预训练的源模型适配到新目标域。现有最先进的SFDA方法多针对计算复杂度高的Faster-RCNN检测器,而本文聚焦于实际应用广泛的单阶段检测器YOLO系列。提出一种名为源域无关YOLO(SF-YOLO)的新方法,采用师生框架,学生模型接收经过学习的、目标域特定的图像增强,仅依赖无标签目标数据进行训练,无需特征对齐。由于无标注情况下自训练易受噪声伪标签影响导致精度下降,引入师生通信机制以稳定训练并减少对标注目标数据的依赖。尽管结构简单,该方法在多个具有挑战性的基准数据集上表现优异,甚至有时超越依赖源数据的先进方法。
原文摘要 · Abstract (English)
Source-free domain adaptation (SFDA) is a challenging problem in object detection, where a pre-trained source model is adapted to a new target domain without using any source domain data for privacy and efficiency reasons. Most state-of-the-art SFDA methods for object detection have been proposed for Faster-RCNN, a detector that is known to have high computational complexity. This paper focuses on domain adaptation techniques for real-world vision systems, particularly for the YOLO family of single-shot detectors known for their fast baselines and practical applications. Our proposed SFDA method - Source-Free YOLO (SF-YOLO) - relies on a teacher-student framework in which the student receives images with a learned, target domain-specific augmentation, allowing the model to be trained with only unlabeled target data and without requiring feature alignment. A challenge with self-training using a mean-teacher architecture in the absence of labels is the rapid decline of accuracy due to noisy or drifting pseudo-labels. To address this issue, a teacher-to-student communication mechanism is introduced to help stabilize the training and reduce the reliance on annotated target data for model selection. Despite its simplicity, our approach is competitive with state-of-the-art detectors on several challenging benchmark datasets, even sometimes outperforming methods that use source data for adaptation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。