arXiv:2506.21484cs.CVcs.AI2025-06ICCV被引 2

TITAN通过分层伪标签提升无源域自适应检测性能

TITAN: Query-Token based Domain Adaptive Adversarial Learning

论文配图:TITAN: Query-Token based Domain Adaptive Adversarial Learning
图 1 · 摘自论文原文
  • 按目标图像与源域相似性分组,区分易难样本
  • 在四个自然数据集上提升mAP达22.7%以上
  • 适合医疗等复杂领域的小样本域适应场景

针对源数据不可用时的目标域自适应物体检测问题,现有方法多采用学生-教师框架生成伪标签进行微调。然而,由于伪标签噪声高(源于域偏移和显著域差异),教师模型常崩溃导致学生模型性能急剧下降。为此,本文提出基于查询令牌的靶向迭代对抗网络(TITAN),将目标图像分为与源域相似(易)和不相似(难)两类。通过估计检测方差实现划分——方差越高,召回率越高,越接近源域。同时,在学生-教师框架中引入基于查询令牌的对抗模块,缩小特征表示的域间差距。在四个自然图像数据集及两个挑战性医学数据集上的实验表明,TITAN优于当前SOTA:在C2F、C2B、S2C、K2C基准上分别提升mAP +22.7%、+22.2%、+21.1%、+3.7%。

原文摘要 · Abstract (English)

We focus on the source-free domain adaptive object detection (SF-DAOD) problem when source data is unavailable during adaptation and the model must adapt to an unlabeled target domain. The majority of approaches for the problem employ a self-supervised approach using a student-teacher (ST) framework where pseudo-labels are generated via a source-pretrained model for further fine-tuning. We observe that the performance of a student model often degrades drastically, due to the collapse of the teacher model, primarily caused by high noise in pseudo-labels, resulting from domain bias, discrepancies, and a significant domain shift across domains. To obtain reliable pseudo-labels, we propose a Target-based Iterative Query-Token Adversarial Network (TITAN), which separates the target images into two subsets: those similar to the source (easy) and those dissimilar (hard). We propose a strategy to estimate variance to partition the target domain. This approach leverages the insight that higher detection variances correspond to higher recall and greater similarity to the source domain. Also, we incorporate query-token-based adversarial modules into a student-teacher baseline framework to reduce the domain gaps between two feature representations. Experiments conducted on four natural imaging datasets and two challenging medical datasets have substantiated the superior performance of TITAN compared to existing state-of-the-art (SOTA) methodologies. We report an mAP improvement of +22.7, +22.2, +21.1, and +3.7 percent over the current SOTA on C2F, C2B, S2C, and K2C benchmarks, respectively.

域自适应目标检测伪标签医学图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。