对比自监督与监督预训练,发现前者更适应跨城市自动驾驶泛化。
Zero-Shot Cross-City Generalization in End-to-End Autonomous Driving: Self-Supervised versus Supervised Representations
- 用自监督模型替代传统监督预训练,提升跨城市驾驶泛化能力。
- 在不同城市间迁移时,自监督方法使位移和碰撞错误显著降低。
- 适合关注自动驾驶系统真实场景鲁棒性的研究者参考。
端到端自动驾驶模型通常基于多城市数据集,使用ImageNet预训练的监督骨干网络进行训练,但其在未见城市间的泛化能力尚未充分评估。当训练与测试数据地理混合时,模型可能隐式依赖城市特有线索,掩盖了真实域偏移下的失败模式。本文将零样本跨城市迁移作为表示层的压力测试,探究视觉预训练对地理域偏移下迁移行为的影响。通过集成I-JEPA、DINOv2和MAE等自监督骨干网络,在nuScenes(开环)和NAVSIM(闭环)上进行严格地理划分下的评估。结果表明,面对不同道路拓扑、交通习惯和视觉环境的城市间迁移,存在显著泛化差距。开环设置中,监督骨干网络表现严重下降,而部分自监督方法能大幅减少位移与碰撞误差;闭环设置中,自监督预训练在多个单城市训练场景下提升了平均分布外PDMS。实证显示表示学习影响跨城市规划的鲁棒性,支持将零样本地理迁移作为评估端到端自动驾驶系统的重要压力测试。
原文摘要 · Abstract (English)
End-to-end autonomous driving models are typically trained on multi-city datasets using supervised ImageNet-pretrained backbones, yet their ability to generalize to unseen cities remains largely unexamined. When training and evaluation data are geographically mixed, models may implicitly rely on city-specific cues, masking failure modes that would occur under real-world domain shifts when generalizing to new locations. In this work, we formulate zero-shot cross-city transfer as a controlled representation-level stress test for end-to-end autonomous driving and ask how visual pretraining affects transfer behavior under geographic domain shift. We conduct a comprehensive study by integrating self-supervised backbones I-JEPA, DINOv2, and MAE into planning frameworks. We evaluate performance under strict geographic splits on nuScenes in the open-loop setting and on NAVSIM in the closed-loop evaluation protocol. Our experiments reveal a substantial generalization gap when transferring models across cities with different road topologies, traffic conventions, and visual environments. In open-loop evaluation, a supervised backbone exhibits severe degradation when transferring between cities, yet some domain-specific self-supervised methods can substantially reduce both displacement and collision degradation. In closed-loop evaluation, self-supervised pretraining improves average out-of-distribution PDMS in several single-city training settings. Our results provide empirical evidence that representation learning influences the robustness of cross-city planning and motivate zero-shot geographic transfer as an important stress test for evaluating end-to-end autonomous driving systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。