用因果推理提升目标检测跨域泛化能力,解决光照等干扰因素导致的误判问题。
Bridge: Basis-Driven Causal Inference Marries VFMs for Domain Generalization

- 通过学习低秩基实现前门调整,阻断光照等混淆因子影响
- 在多个跨域数据集上优于现有最先进方法,最高提升6.8% mAP
- 兼容判别与生成式视觉模型,适合实际部署场景
检测器在跨域场景下性能下降,主要源于源域与目标域之间的分布差异。尤其在单源数据有限的情况下,模型易依赖源域中的混淆因子(如光照、共现关系和风格),产生虚假相关性,阻碍泛化。为此,本文提出一种基于基础的领域泛化框架——Bridge,将因果推断融入目标检测。通过学习用于前门调整的低秩基,Bridge 能有效阻断混淆因子的影响,缓解虚假相关性;同时通过过滤冗余和任务无关成分,优化表示。该方法可无缝集成于判别式(如 DINOv2/3、SAM)与生成式(如 Stable Diffusion)视觉基础模型(VFMs)。在多个领域泛化目标检测数据集(包括 Cross-Camera、Adverse Weather、Real-to-Artistic、Diverse Weather Datasets 及我们新构建的 UAV 基真实世界基准 Diverse Weather DroneVehicle)上的大量实验表明,所提方法显著优于现有最先进方法。
原文摘要 · Abstract (English)
Detectors often suffer from degraded performance, primarily due to the distributional gap between the source and target domains. This issue is especially evident in single-source domains with limited data, as models tend to rely on confounders (e.g., illumination, co-occurrence, and style) from the source domain, leading to spurious correlations that hinder generalization. To this end, this paper proposes a novel Basis-driven framework for domain generalization, namely \textbf{\textit{Bridge}}, that incorporates causal inference into object detection. By learning the low-rank bases for front-door adjustment, \textbf{\textit{Bridge}} blocks confounders' effects to mitigate spurious correlations, while simultaneously refining representations by filtering redundant and task-irrelevant components. \textbf{\textit{Bridge}} can be seamlessly integrated with both discriminative (e.g., DINOv2/3, SAM) and generative (e.g., Stable Diffusion) Vision Foundation Models (VFMs). Extensive experiments across multiple domain generalization object detection datasets, i.e., Cross-Camera, Adverse Weather, Real-to-Artistic, Diverse Weather Datasets, and Diverse Weather DroneVehicle (our newly augmented real-world UAV-based benchmark), underscore the superiority of our proposed method over previous state-of-the-art approaches. The project page is available at: https://mingbohong.github.io/Bridge/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。