针对真实场景下半监督目标检测的噪声与类别不均衡问题,提出四项可插拔改进方案。
Building Blocks for Robust and Effective Semi-Supervised Real-World Object Detection
- 通过罕见类拼接和分层采样增强稀有类别表征
- 利用教师模型一致性修正真实标签,提升标注质量
- 基于缺失检测率估计筛选伪标签,有效去除低质样本
基于伪标签的半监督目标检测(SSOD)显著降低了对大规模标注数据的依赖,但真实应用场景中常面临类别不平衡、标签噪声和标注错误等挑战。本文深入分析了真实条件下SSOD的表现,揭示了伪标签效果不佳的根本原因及标签质量与数量间的权衡关系。基于此,提出四个可无缝集成到现有框架中的构建模块:罕见类拼接(RCC)通过合成稀有对象图像增强其表征;罕见类聚焦(RCF)采用分层批次采样策略保证各类别训练平衡;真实标签修正(GLC)利用教师模型预测一致性识别并修正错误、遗漏和噪声标签;伪标签选择(PLS)则基于新型缺失检测率估计指标,筛选低质量伪标签图像。在自动驾驶数据集上的大量实验表明,该方法最高可使SSOD性能提升6%。整体上,本研究提出的以数据为中心、广泛适用的构建模块,显著提升了复杂真实场景下的鲁棒性与有效性。代码已公开于https://mos-ks.github.io/publications。
原文摘要 · Abstract (English)
Semi-supervised object detection (SSOD) based on pseudo-labeling significantly reduces dependence on large labeled datasets by effectively leveraging both labeled and unlabeled data. However, real-world applications of SSOD often face critical challenges, including class imbalance, label noise, and labeling errors. We present an in-depth analysis of SSOD under real-world conditions, uncovering causes of suboptimal pseudo-labeling and key trade-offs between label quality and quantity. Based on our findings, we propose four building blocks that can be seamlessly integrated into an SSOD framework. Rare Class Collage (RCC): a data augmentation method that enhances the representation of rare classes by creating collages of rare objects. Rare Class Focus (RCF): a stratified batch sampling strategy that ensures a more balanced representation of all classes during training. Ground Truth Label Correction (GLC): a label refinement method that identifies and corrects false, missing, and noisy ground truth labels by leveraging the consistency of teacher model predictions. Pseudo-Label Selection (PLS): a selection method for removing low-quality pseudo-labeled images, guided by a novel metric estimating the missing detection rate while accounting for class rarity. We validate our methods through comprehensive experiments on autonomous driving datasets, resulting in up to 6% increase in SSOD performance. Overall, our investigation and novel, data-centric, and broadly applicable building blocks enable robust and effective SSOD in complex, real-world scenarios. Code is available at https://mos-ks.github.io/publications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。