用视觉槽结构提升无源目标检测的跨域适应能力
CGSA: Class-Guided Slot-Aware Adaptation for Source-Free Object Detection
- 引入分层视觉槽模块,将图像分解为具语义的视觉片段
- 通过类别引导对比学习,实现跨域特征的语义一致性
- 适合隐私敏感场景下的无源域适应,代码已开源
无源域自适应目标检测(SF-DAOD)旨在不保留源域数据的情况下,将标注过的源域检测器迁移到未标注的目标域。尽管已有进展,现有方法多聚焦于调整伪标签阈值或优化教师-学生框架,忽略了跨域数据中的物体级结构线索。本文提出CGSA,首个将对象中心学习(OCL)引入SF-DAOD的方法,通过在DETR-based检测器中集成槽感知适配机制。具体而言,采用分层槽感知(HSA)模块,逐步将图像解耦为作为视觉先验的槽表示;再通过类别引导槽对比(CGSC)模块,引导槽向类别语义对齐,保持语义一致性并促进域不变适应。在多个跨域数据集上的实验表明,本方法优于以往的SF-DAOD方法;理论推导与实证分析进一步验证了各组件的有效性,凸显了对象中心设计在隐私敏感场景中的潜力。代码已发布于https://github.com/Michael-McQueen/CGSA。
原文摘要 · Abstract (English)
Source-Free Domain Adaptive Object Detection (SF-DAOD) aims to adapt a detector trained on a labeled source domain to an unlabeled target domain without retaining any source data. Despite recent progress, most popular approaches focus on tuning pseudo-label thresholds or refining the teacher-student framework, while overlooking object-level structural cues within cross-domain data. In this work, we present CGSA, the first framework that brings Object-Centric Learning (OCL) into SF-DAOD by integrating slot-aware adaptation into the DETR-based detector. Specifically, our approach integrates a Hierarchical Slot Awareness (HSA) module into the detector to progressively disentangle images into slot representations that act as visual priors. These slots are then guided toward class semantics via a Class-Guided Slot Contrast (CGSC) module, maintaining semantic consistency and prompting domain-invariant adaptation. Extensive experiments on multiple cross-domain datasets demonstrate that our approach outperforms previous SF-DAOD methods, with theoretical derivations and experimental analysis further demonstrating the effectiveness of the proposed components and the framework, thereby indicating the promise of object-centric design in privacy-sensitive adaptation scenarios. Code is released at https://github.com/Michael-McQueen/CGSA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。