解决无源目标检测中的类别偏见问题,提升小类识别效果。
Context Aware Grounded Teacher for Source Free Object Detection
- 通过关系与语义正则化,动态建模跨域上下文偏见。
- 在医疗数据上实现5.9的AP50提升,小类召回率显著改善。
- 适合医学图像等存在严重类别不平衡的场景使用。
无源目标检测(SFOD)因类别不平衡引发的上下文偏见及噪声伪标签下的师生训练不稳定性而面临持续挑战。现有方法通常忽略上下文偏见和类别不平衡变化,尤其在医学数据中表现不佳。为此,我们提出接地教师(GT),一种具备偏见感知能力的无源框架,通过关系与语义正则化对教师模型进行约束。为显式建模类别间的方向性混淆,GT引入关系上下文模块(RCM),采用指数移动平均(EMA)估计跨域上下文偏见。在此基础上,设计语义增强(SA)策略,在源相似与源异构目标区域中自适应地对少数类和易混淆类进行混合增强(MixUp),提升少数类召回率且避免主导类别过拟合。为稳定噪声伪标签下的学习过程,提出语义感知损失(SAL),采用对角归一化权重,防止梯度爆炸并强化少数-多数类修正。此外,利用来自大视觉基础模型(LVFMs)的冻结专家分支作为训练期间的监督参考,提升伪标签质量而不增加推理开销。GT的行为驱动偏见量化使其可广泛适用于不同领域,无需依赖数据集先验。在Cityscapes-to-Foggy(50.8 mAP)和医学数据迁移(DDSM-to-INBreast +5.9 AP50)上的评估均显示持续增益,小类检测性能显著提升,额外训练成本低于12%。代码与模型已公开于 https://github.com/Tajamul21/Grounded-Teacher。
原文摘要 · Abstract (English)
Source-free object detection (SFOD) faces persistent challenges due to class imbalance-driven context bias and instability in teacher-student training under noisy pseudo-labels. Existing techniques tend to ignore context bias and class-imbalance shifts, especially in medical data. To tackle this, we propose Grounded Teacher (GT), a bias-aware source-free framework that grounds the teacher model through relational and semantic regularization. To explicitly model directional confusion between classes, GT introduces a Relational Context Module (RCM) that maintains an exponential moving average (EMA) estimate of cross-domain contextual bias. Building upon this, a Semantic Augmentation (SA) strategy selectively augments minority and confusable classes through adaptive MixUp in both source-similar and source-dissimilar target regions, improving minority recall without overfitting dominant categories. To stabilize learning under biased pseudo-labels, we design a Semantic-Aware Loss (SAL) that applies diagonally normalized weights, preventing gradient explosion while emphasizing minority-majority corrections. Additionally, a frozen Expert branch derived from large vision foundation models (LVFMs) serves as a supervisory reference during training, refining pseudo-label quality without adding inference overhead. GT's behavior-driven bias quantification makes it broadly applicable across domains without relying on dataset priors. Evaluations on Cityscapes-to-Foggy (50.8 mAP) and medical transfers (+5.9 AP50 on DDSM-to-INBreast) show consistent gains and improved minority-class detection, with less than 12\% additional training cost. Code and model are available at https://github.com/Tajamul21/Grounded-Teacher.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。