通过特征回归到语义流形,提升模型在未知场景下的检测鲁棒性。
Prototype-Anchored Generalized Manifold Regression for Unknown-Domain Object Detection

- 将未知域泛化建模为流形回归问题,用原型锚定修复偏离特征。
- 在三个基准上实现优于现有方法的跨域检测性能,尤其在恶劣天气下表现突出。
- 适合需要高鲁棒性的实际部署场景,如自动驾驶、机器人视觉。
本文研究单源域广义目标检测(Single-DGOD),旨在将单一源域训练的检测器迁移到多个未见域。现有方法多依赖仿真策略(如数据增强或文本提示)扩大训练分布,但有限仿真难以覆盖真实场景的动态变化,常导致对合成风格过拟合,且对复杂结构退化鲁棒性差。受流形假设启发,我们认为尽管视觉变化多样,语义特征应位于紧凑稳定的低维流形上。因此,稳健泛化需将偏离样本纠正回该语义流形,而非穷尽模拟外部扰动。为此,提出视觉-文本双链思维的流形回归(MR-DCoT),将未知域泛化建模为流形回归问题。该方法先通过视觉-文本双链思维模块,结合VLM引导的语义演化与基于扩散的结构扰动,生成结构化的离群难例;再引入类别专属原型锚定,学习一个投影算子,将偏离特征向源域语义流形对齐。通过将异常样本生成与语义修正整合为闭环,有效缩小分布差距,提升对未见变化的鲁棒性。在三个互补基准上的实验——包括恶劣天气检测、真实到艺术泛化、零样本语义分割——验证了方法的有效性与通用性。
原文摘要 · Abstract (English)
In this paper, we study Single-Domain Generalized Object Detection (Single-DGOD), which aims to transfer a detector trained on a single source domain to multiple unseen domains. Existing methods mainly rely on simulation-driven strategies, such as data augmentation or textual prompts, to enlarge the training distribution. However, finite simulations can hardly cover the dynamic variations of real-world scenarios, often causing overfitting to synthetic styles and limited robustness to complex structural degradations. Inspired by the manifold hypothesis, we argue that semantic features, despite diverse visual changes, should lie on a compact and stable low-dimensional manifold. Therefore, robust generalization requires rectifying deviant samples back to this semantic manifold, rather than exhaustively simulating external perturbations. To this end, we propose Manifold Regression with Visual-Text Dual Chain-of-Thought (MR-DCoT), which formulates unknown-domain generalization as a manifold regression problem. MR-DCoT first uses a Visual-Text Dual Chain-of-Thought module to combine VLM-guided semantic evolution with diffusion-based structural perturbation, generating structured off-manifold hard examples. It then introduces Class-Specific Prototype Anchoring to learn a rectification operator that projects deviant features toward the source semantic manifold. By integrating outlier generation and semantic correction into a closed loop, MR-DCoT effectively narrows the distribution gap and improves robustness under unseen shifts. Extensive experiments on three complementary benchmarks, including adverse-weather detection, real-to-art generalization, and zero-shot semantic segmentation, demonstrate the effectiveness and versatility of our method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。