提出实时检测框架RT-DATR,解决跨域检测中特征不一致问题。
RT-DATR: Real-time Unsupervised Domain Adaptive Detection Transformer with Adversarial Feature Alignment
- 设计局部物体级与场景语义级特征对齐模块,增强域不变性
- 引入独立域查询解耦对象查询,提升实例特征分布对齐
- 在多个跨域基准上超越现有方法,适合实时检测应用
尽管基于CNN和Transformer的域自适应目标检测器在跨域检测任务中已取得显著进展,但针对实时Transformer检测器的域自适应研究仍属空白。直接应用现有域自适应算法效果不佳。本文提出RT-DATR,一种简单高效的实时域自适应检测变压器。以RT-DETR为基础检测器,首先引入局部物体级特征对齐模块,显著增强物体迁移中的特征表示域不变性;其次设计场景语义特征对齐模块,通过对齐场景语义特征提升跨域检测性能;最后引入域查询并将其从对象查询中解耦,进一步对齐解码器层内的实例特征分布,缩小域差距,同时保持判别能力。在多个跨域基准上的实验结果表明,该方法优于当前最先进方法。代码已公开于https://github.com/Jeremy-lf/RT-DATR。
原文摘要 · Abstract (English)
Despite domain-adaptive object detectors based on CNN and transformers have made significant progress in cross-domain detection tasks, it is regrettable that domain adaptation for real-time transformer-based detectors has not yet been explored. Directly applying existing domain adaptation algorithms has proven to be suboptimal. In this paper, we propose RT-DATR, a simple and efficient real-time domain adaptive detection transformer. Building on RT-DETR as our base detector, we first introduce a local object-level feature alignment module to significantly enhance the feature representation of domain invariance during object transfer. Additionally, we introduce a scene semantic feature alignment module designed to boost cross-domain detection performance by aligning scene semantic features. Finally, we introduced a domain query and decoupled it from the object query to further align the instance feature distribution within the decoder layer, reduce the domain gap, and maintain discriminative ability. Experimental results on various cross-domian benchmarks demonstrate that our method outperforms current state-of-the-art approaches. Code is available at https://github.com/Jeremy-lf/RT-DATR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。