让自动驾驶理解交通规则像人一样推理
Reasoning to Regulate: Chain-of-Thought for Traffic Rule Understanding

- 用思维链引导视觉语言模型分析标志与道路结构关系
- 在MapDR数据集上准确率显著提升,解释性更强
- 适合需要可解释决策的自动驾驶系统研究者
理解并遵守交通规则是自动驾驶安全的关键挑战,因交通标志多样且依赖场景上下文。规则理解并非简单识别,而是需结合标志语义与车道布局进行推理。为此,MapDR提供细粒度标注,将每个交通标志的规则与其所管辖车道关联。现有方法多将其视为直接序列预测,忽视了背后的推理过程。本文提出一种框架,为视觉语言模型(VLM)注入思维链(CoT)能力。首先设计可扩展的CoT构建流程,通过两轮策略从强语言模型生成推理链,并用VLM验证器剔除错误案例,得到高质量的(推理链,答案)对。在此基础上,采用两阶段训练:监督微调(SFT)学习从推理链生成答案,再以答案导向的细粒度奖励进行GRPO强化学习,进一步提升最终答案准确性。在MapDR上的大量实验表明,该方法显著提升了可解释性与准确率,建立了首个基于推理的规则感知自动驾驶框架。
原文摘要 · Abstract (English)
Understanding and complying with traffic regulations is a safety-critical requirement for autonomous driving, yet remains challenging due to the diversity and context dependence of traffic signage. Importantly, regulation understanding is not a simple recognition task, but a reasoning problem: whether a rule applies depends on interpreting the sign in relation to the spatial layout of lanes and scene context. To support such reasoning, MapDR provide fine-grained annotations that link each traffic sign's regulatory rules to the specific lanes they govern. Existing methods, however, largely treat this as direct sequence prediction, ignoring the underlying reasoning that connects sign semantics and map structure. To address this limitation, we explicitly incorporate reasoning into this task and propose a framework that equips vision-language models (VLMs) with chain-of-thought (CoT) capabilities. We first design a scalable CoT curation pipeline that bootstraps rationales from a strong LLM through a two-round strategy and employs a VLM-based verifier to filter out incorrect cases, yielding a high-quality set of (CoT, answer) pairs. Building on this foundation, we adopt a two-stage training scheme: supervised fine-tuning (SFT) to teach rationale-to-answer generation, followed by GRPO reinforcement learning with answer-grounded, fine-grained rewards to further improve final answer accuracy. Extensive experiments on MapDR show that our approach significantly improves both interpretability and accuracy, establishing the first reasoning-based framework for regulation-aware autonomous driving.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。