arXiv:2604.27994cs.RO2026-04

让自动驾驶模型跨城泛化,不靠新数据也能稳驾陌生城镇。

Dreaming Across Towns: Semantic Rollout and Town-Adversarial Regularization for Zero-Shot Held-Out-Town Fixed-Route Driving in CARLA

论文配图:Dreaming Across Towns: Semantic Rollout and Town-Adversarial Regularization for Zero-Shot Held-Out-Town Fixed-Route Driving in CARLA
图 1 · 摘自论文原文
  • 用未来视觉语义预测+对抗性去源城特征,提升跨城迁移能力。
  • 在未见城镇中平均成功率36.6%(Town03)和85.6%(Town04)。
  • 适合研究零样本跨场景自动驾驶的科研人员参考。

在CARLA模拟器中,仅在Town05和Town06训练的驾驶智能体需直接评估于未见的Town03与Town04,且不提供任何测试城镇的数据。为聚焦道路布局差异的影响,所有实验采用相同天气与交通设置。本文提出一种训练方法,促使智能体学习跨城通用特征而非依赖特定训练城镇的特征。训练期间,要求智能体预测未来相机视图的高层语义,并抑制对来源城镇线索的依赖。这些额外信号仅用于训练,推理时仍保持与基线相同的观测与控制接口。在与匹配的DreamerV3风格世界模型对比中,所提方法在未见城镇上取得最高平均成功:Town03为36.6%(95%置信区间[30.5, 42.7]),Town04为85.6%([84.0, 87.2]),基于五次随机种子测试。配对种子实验显示,在两个未见城镇上均优于最强基线。进一步实验表明,单独使用未来语义预测或去除源城线索均无法达到联合方法效果。结果表明,结合未来场景理解与减少源城特异性依赖,可有效提升该设定下的跨城驾驶性能。

原文摘要 · Abstract (English)

Driving agents trained in one simulated town often perform poorly in a new town because the road shapes, intersections, and lane layouts can be different. This paper studies how to improve this kind of transfer in the CARLA driving simulator without giving the agent any training data from the test towns. The agent is trained only in Town05 and Town06, then evaluated directly in Town03 and Town04. To focus on road-layout differences, all experiments use the same weather and traffic settings. We propose a training method that encourages the agent to learn features that are useful across towns rather than features tied to one training town. During training, the agent is asked to predict the high-level visual meaning of future camera views and is also discouraged from relying on cues that reveal which source town the data came from. These extra learning signals are used only during training; at test time, the driving policy uses the same observation and control interface as the baseline agent. In controlled comparisons with matched DreamerV3-style world-model driving agents, the proposed method achieves the highest mean held-out success: 36.6\% on Town03 with a 95\% confidence interval of [30.5, 42.7] and 85.6\% on Town04 with a 95\% confidence interval of [84.0, 87.2], computed across five training seeds. Seed-paired tests against the strongest primary baselines show positive success-rate differences in both held-out towns. Additional experiments show that predicting future visual meaning alone or removing town-specific cues alone is not enough to match the combined method. These results suggest that combining future-scene understanding with reduced reliance on source-town-specific features can improve cross-town driving performance in this CARLA setting.

自动驾驶跨域迁移生成模型仿真测试

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。