arXiv:2511.12755cs.ROcs.LG2025-11

无需重训练,用少量驾驶轨迹让自动驾驶模型适应恶劣天气。

Prompt-Driven Domain Adaptation for End-to-End Autonomous Driving via In-Context RL

  • 在推理时通过上下文强化学习,利用观察到的驾驶轨迹动态调整策略。
  • 在CARLA模拟器中实现更安全、高效、舒适的恶劣天气驾驶表现。
  • 首次将提示驱动适配扩展至闭环驾驶,且无需专家数据或参数更新。

尽管自动驾驶领域取得显著进展,但许多端到端系统在域适应(DA)方面仍面临挑战,例如将晴天训练的策略迁移至恶劣天气。现有方法通常依赖目标域数据收集或模型重训练,但随着系统规模与复杂度增加,这些方法迅速变得不切实际。为此,研究者探索了基于大语言模型和视觉语言模型的少样本、零样本推理时提示驱动域适应。这类方法在推理时通过添加少量状态-动作轨迹作为提示(类似上下文学习)。然而当前方法存在两个局限:(i) 仅适用于感知任务(如检测与分割),(ii) 需要专家提供的少样本数据。本文提出一种新的推理时少样本提示驱动域适应方法,基于上下文强化学习(ICRL),用于恶劣天气下的闭环自动驾驶。与以往方法类似,本方法不更新模型参数,也无需在恶劣天气下收集额外数据。更重要的是,该方法首次将提示驱动适配扩展至闭环驾驶,并可使用推理过程中观测到的一般轨迹。在CARLA模拟器上的实验表明,相比现有提示驱动基线,该方法在目标域中实现了更安全、更高效、更舒适的驾驶策略。

原文摘要 · Abstract (English)

Despite significant progress and advances in autonomous driving, many end-to-end systems still struggle with domain adaptation (DA), such as transferring a policy trained under clear weather to adverse weather conditions. Typical DA strategies in the literature include collecting additional data in the target domain or re-training the model, or both. Both these strategies quickly become impractical as we increase scale and complexity of driving. These limitations have encouraged investigation into few-shot and zero-shot prompt-driven DA at inference time involving LLMs and VLMs. These methods work by adding a few state-action trajectories during inference to the prompt (similar to in-context learning). However, there are two limitations of such an approach: $(i)$ prompt-driven DA methods are currently restricted to perception tasks such as detection and segmentation and $(ii)$ they require expert few-shot data. In this work, we present a new approach to inference-time few-shot prompt-driven DA for closed-loop autonomous driving in adverse weather condition using in-context reinforcement learning (ICRL). Similar to other prompt-driven DA methods, our approach does not require any updates to the model parameters nor does it require additional data collection in adversarial weather regime. Furthermore, our approach advances the state-of-the-art in prompt-driven DA by extending to closed driving using general trajectories observed during inference. Our experiments using the CARLA simulator show that ICRL results in safer, more efficient, and more comfortable driving policies in the target domain compared to state-of-the-art prompt-driven DA baselines.

自动驾驶提示驱动强化学习域适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。