针对DETR架构的无源目标检测新方法,提升模型在无源数据下的泛化能力。
Source-Free Object Detection with Detection Transformer
- 基于注意力机制重加权检测损失,聚焦难识别区域
- 通过对比学习与动态教师更新,显著提升伪标签质量
- 专为DETR设计,适合追求高精度目标检测的研究者
无源目标检测(SFOD)可在不访问源域数据的情况下,将知识从源域迁移至无监督的目标域。现有方法多局限于Faster R-CNN等传统检测模型,或缺乏对新型检测器如检测变压器(DETR)的针对性优化。本文提出FRANCK框架,专为DETR设计,实现查询中心的特征增强。其包含四个核心组件:(1) 基于置信度的样本重加权(OSSR)模块,在多尺度编码器特征图上计算注意力置信度,重新加权检测损失以强调低识别区域;(2) 基于匹配的记忆库对比学习(CMMB)模块,将多层级特征整合至记忆库,强化类别间对比学习;(3) 不确定性加权的查询融合特征蒸馏(UQFD)模块,通过预测质量重加权和查询特征融合提升特征蒸馏效果;(4) 改进的自训练流程,采用动态教师更新间隔(DTUI),优化伪标签质量。实验表明,FRANCK在多个主流基准上达到当前最优性能,验证了其在DETR-based SFOD中的有效性与兼容性。
原文摘要 · Abstract (English)
Source-Free Object Detection (SFOD) enables knowledge transfer from a source domain to an unsupervised target domain for object detection without access to source data. Most existing SFOD approaches are either confined to conventional object detection (OD) models like Faster R-CNN or designed as general solutions without tailored adaptations for novel OD architectures, especially Detection Transformer (DETR). In this paper, we introduce Feature Reweighting ANd Contrastive Learning NetworK (FRANCK), a novel SFOD framework specifically designed to perform query-centric feature enhancement for DETRs. FRANCK comprises four key components: (1) an Objectness Score-based Sample Reweighting (OSSR) module that computes attention-based objectness scores on multi-scale encoder feature maps, reweighting the detection loss to emphasize less-recognized regions; (2) a Contrastive Learning with Matching-based Memory Bank (CMMB) module that integrates multi-level features into memory banks, enhancing class-wise contrastive learning; (3) an Uncertainty-weighted Query-fused Feature Distillation (UQFD) module that improves feature distillation through prediction quality reweighting and query feature fusion; and (4) an improved self-training pipeline with a Dynamic Teacher Updating Interval (DTUI) that optimizes pseudo-label quality. By leveraging these components, FRANCK effectively adapts a source-pre-trained DETR model to a target domain with enhanced robustness and generalization. Extensive experiments on several widely used benchmarks demonstrate that our method achieves state-of-the-art performance, highlighting its effectiveness and compatibility with DETR-based SFOD models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。