用规则引擎生成的推理链训练自动驾驶模型,让决策过程更可信。
Neuro-Symbolic Drive: Rule-Grounded Faithful Reasoning for Driving VLAs

- 从经典规则规划器提取结构化推理轨迹作为监督信号
- 三摄像头下轨迹误差降为0.26,漏检率降至6.40%
- 适合追求可解释性与安全性的自动驾驶系统研发
将链式思维(CoT)推理引入驾驶视觉语言模型(VLA),虽能利用预训练视觉语言模型表征并以自然语言暴露中间决策,但现有推理常缺乏与运动规划因果关联的逐步决策语义。本文提出神经符号驱动框架,直接从经典规则规划器中提取规则根基的推理轨迹作为监督信号。核心观察是:规则规划器本身即为可执行的推理引擎,可处理主动安全约束、搜索候选动作并选择最终轨迹。我们在仿真中对规划器进行改造,记录每一步规则评估的内部决策轨迹及其对应的实际行驶路径。将这些轨迹序列化为结构化的规则推理,并与轨迹配对,用于微调Qwen3.5-4B驾驶VLA。由于推理轨迹源自决定动作的规划状态,其与运动生成在结构上天然耦合,而非事后对齐。在自动生成的基准测试中,详细规则推理使三摄像头感知下的ADE@3s从0.47降至0.26,漏检率从8.30%降至6.40%;八摄像头下分别从0.54降至0.26,10.13%降至5.99%。该方法成功将神经符号规划逻辑转化为结构化监督信号。
原文摘要 · Abstract (English)
Driving VLA models incorporating Chain-of-Thought (CoT) reasoning are attractive because they leverage pretrained VLM representations and expose intermediate decisions in natural language, yet current rationales often lack the step-by-step decision semantics needed to keep the rationale causally connected to the planned motion. We introduce Neuro-Symbolic Drive, a neuro-symbolic driving framework that supervises a driving VLA with rule-grounded reasoning traces extracted directly from classical rule-based planners. Our key observation is that rule-based planners are symbolic AI systems that already function as executable reasoning engines: they reason about active safety constraints, search over candidate maneuvers, and select a final trajectory. We instrument these planners in simulation to capture both the executed trajectory and the internal decision trace at each rule-evaluation step. Each trace is serialized into structured rule-grounded reasoning and paired with the trajectory to fine-tune Qwen3.5-4B as a driving VLA. Because these traces are derived directly from the planner states that determine the action, they ensure reasoning is structurally coupled to motion generation by construction, rather than by post-hoc alignment. On our simulator-generated benchmark, detailed rule-grounded reasoning reduces ADE@3s from 0.47 to 0.26 and miss rate from 8.30% to 6.40% under three-camera perception, and from 0.54 to 0.26 and 10.13% to 5.99% under eight-camera perception. Neuro-Symbolic Drive thus converts neuro-symbolic planning logic into structured supervision. Code base: https://github.com/XiangboGaoBarry/Neural-Symbolic-Drive.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。