arXiv:2602.12563cs.CV2026-02

分离外观与结构变化,测试自动驾驶在不同天气下的鲁棒性

The Constant Eye: Benchmarking and Bridging Appearance Robustness in Autonomous Driving

  • 用生成式风格迁移创建仅改变外观的视觉测试集
  • 现有规划模型在雨天等外观变化下性能显著下降
  • 提出冻结视觉模型接口,实现跨模型零样本泛化

尽管自动驾驶算法进展迅速,但在分布外(OOD)条件下仍表现脆弱。我们发现当前研究存在关键脱节:未能区分外观变化(如天气、光照)与场景结构变化。这导致根本问题未解:规划器失效是因复杂道路几何,还是仅仅因为下雨?为此,我们建立navdream高保真鲁棒性基准,采用生成式像素对齐风格迁移技术,在几何几乎不变的前提下制造视觉压力测试,隔离外观变化对驾驶性能的影响。评估显示,现有规划算法在分布外外观条件下性能大幅下降,即使场景结构保持一致。为弥合这一差距,我们提出一种通用感知接口,利用冻结的视觉基础模型(DINOv3)提取外观不变特征,作为规划器的稳定输入。该方案在回归、扩散和评分等多种规划范式上均实现卓越的零样本泛化能力,且在极端外观变化下无需微调即可保持稳定性能。基准与代码将公开。

原文摘要 · Abstract (English)

Despite rapid progress, autonomous driving algorithms remain notoriously fragile under Out-of-Distribution (OOD) conditions. We identify a critical decoupling failure in current research: the lack of distinction between appearance-based shifts, such as weather and lighting, and structural scene changes. This leaves a fundamental question unanswered: Is the planner failing because of complex road geometry, or simply because it is raining? To resolve this, we establish navdream, a high-fidelity robustness benchmark leveraging generative pixel-aligned style transfer. By creating a visual stress test with negligible geometric deviation, we isolate the impact of appearance on driving performance. Our evaluation reveals that existing planning algorithms often show significant degradation under OOD appearance conditions, even when the underlying scene structure remains consistent. To bridge this gap, we propose a universal perception interface leveraging a frozen visual foundation model (DINOv3). By extracting appearance-invariant features as a stable interface for the planner, we achieve exceptional zero-shot generalization across diverse planning paradigms, including regression-based, diffusion-based, and scoring-based models. Our plug-and-play solution maintains consistent performance across extreme appearance shifts without requiring further fine-tuning. The benchmark and code will be made available.

自动驾驶鲁棒性视觉不变性DINOv3

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。