arXiv:2608.20916cs.CV2026-08

解决视觉大模型跨域检测中的语义不匹配问题,提升小模型性能。

Semantically Compatible Knowledge Distillation for Cross-Domain Object Detection with Vision Foundation Models

论文配图:Semantically Compatible Knowledge Distillation for Cross-Domain Object Detection with Vision Foundation Models
图 1 · 摘自论文原文
  • 通过轻量适配器注入纹理先验,使教师与学生特征在空间和语义上对齐。
  • 在三个基准上达到顶尖效果,使用DINOv2-B时训练时间仅为DINOv2-G的1/4。
  • 适合计算资源有限但需高效利用大模型知识的跨域检测场景。

视觉基础模型(VFMs)为领域自适应目标检测(DAOD)提供了强大的泛化能力。然而,现有基于VFM的方法忽略了教师与学生特征图之间的空间尺度差异,导致语义不兼容,削弱了特征对齐和伪标签学习效果。此外,领域偏移会使源域训练的VFM教师遗漏目标域物体,降低伪标签质量。为此,我们提出语义定位增强教师(SLE-T),一个围绕DINOv2轻量级SLE适配器构建的语义兼容知识蒸馏框架。SLE适配器将预训练局部纹理先验注入DINOv2,提升跨域识别能力,并将其特征重构为与学生检测器空间和语义兼容的密集表示。SLE-T通过伪标签学习或特征对齐传递教师知识。我们以DINOv2-B和DINOv2-L实例化SLE-T,对比更大的DINOv2-G教师。在三个DAOD基准上的大量实验表明,本方法达到最先进性能,消融实验验证了教师-学生语义兼容性的重要性。值得注意的是,SLE-T搭配DINOv2-B在约四分之一的训练时间内完成,且显著减少GPU内存占用,证明了在有限算力下高效的知识迁移能力。

原文摘要 · Abstract (English)

Vision foundation models (VFMs) offer strong generalization capabilities for domain-adaptive object detection (DAOD). However, existing VFM-based methods overlook the spatial-scale discrepancy between teacher and student feature maps, resulting in semantic incompatibility that weakens both feature alignment and pseudo-label learning. Moreover, domain shift can cause source-trained VFM teachers to miss target-domain objects, limiting the quality of their pseudo-labels. To address these issues, we propose the Semantic Localization-Enhanced Teacher (SLE-T), a semantically compatible knowledge-distillation framework built around a lightweight SLE Adapter for DINOv2. SLE Adapter injects pretrained local-texture priors into DINOv2 to improve cross-domain recognition and reformulates its features into dense representations that are spatially and semantically compatible with the student detector. SLE-T transfers the resulting teacher knowledge through either pseudo-label learning or feature alignment. We instantiate SLE-T with DINOv2-B and DINOv2-L (the ViT-B and ViT-L variants) and compare them with the larger DINOv2-G teacher. Extensive experiments on three DAOD benchmarks demonstrate that our method achieves state-of-the-art performance, and ablation studies confirm the importance of teacher-student semantic compatibility. Notably, SLE-T with DINOv2-B produces competitive or superior pseudo-labels using approximately one-quarter of the training time of DINOv2-G and substantially less GPU memory, demonstrating efficient VFM knowledge transfer under limited computational resources.

目标检测知识蒸馏跨域适应视觉大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。