arXiv:2607.13926cs.RO2026-07

分离语义与空间流,提升自动驾驶模型的精准控制能力。

S-squared-VLA: Decoupling Semantic and Spatial Streams in Vision-Language-Action Models for Autonomous Driving

论文配图:S-squared-VLA: Decoupling Semantic and Spatial Streams in Vision-Language-Action Models for Autonomous Driving
图 1 · 摘自论文原文
  • 拆分语义与空间处理流,避免视觉特征在语言生成中失真。
  • 在闭环测试中实现87.1的预测驾驶员评分和98.4%无碰撞率。
  • 适合需要高精度路径规划的自动驾驶系统研发人员。

视觉-语言模型(VLM)在自动驾驶高层推理中表现优异,但难以生成精确的底层控制动作。这一瓶颈源于离散语言标记与连续轨迹规划之间的语义-物理鸿沟。尽管视觉-语言-动作(VLA)架构试图统一感知与控制,但其耦合结构导致空间表示崩溃,严重削弱对边界感知至关重要的细粒度空间与几何先验。为此,我们提出S-squared-VLA,显式解耦视觉-语言-动作模型中的语义与空间流。语义流通过层级桥接提取多尺度VLM特征以实现稳健意图推理;独立空间流绕过自回归语言瓶颈,直接保留视觉编码器的未压缩空间特征,并通过辅助感知监督显式赋予模型丰富的空间与几何先验。最终,双流规划适配器通过级联注意力机制融合高层语义意图与精确空间约束。在NAVSIM闭环基准测试中,S-squared-VLA在纯监督微调(SFT)设置下达到87.1的预测驾驶员模型评分(PDMS),刷新当前最佳性能。相比基线显著提升,实现98.4%最高无碰撞率。

原文摘要 · Abstract (English)

Vision-Language Models (VLMs) have demonstrated remarkable potential for high-level reasoning in autonomous driving, yet they fundamentally struggle to generate precise, low-level control actions. This limitation is rooted in a semantic-physical gap caused by the inherent mismatch between discrete language tokens and continuous trajectory planning. While Vision-Language-Action (VLA) architectures attempt to bridge this gap by unifying perception and control into a single policy, this entanglement creates a new bottleneck. Standard VLAs experience a severe spatial representation collapse, which irreversibly degrades the fine-grained spatial and geometric priors essential for safe, boundary-aware navigation. To address this limitation, we propose the S-squared-VLA, which explicitly decouples the semantic and spatial streams in Vision-Language-Action models. The semantic stream leverages hierarchical bridging to extract multi-scale VLM features for robust intent reasoning. In parallel, an independent spatial stream bypasses the autoregressive language bottleneck, directly preserving uncompressed spatial features from the visual encoder. By integrating auxiliary perception supervision, this stream explicitly equips the model with rich spatial and geometric priors. Finally, a dual-stream planning adapter fuses high-level semantic intent with precise spatial constraints via cascaded attention mechanisms. Evaluations on the NAVSIM closed-loop benchmark show that S-squared-VLA achieves a Predictive Driver Model Score (PDMS) of 87.1, establishing a new state-of-the-art for VLA models under a purely supervised fine-tuning (SFT) setting. By mitigating the spatial representation collapse of traditional VLMs, our framework significantly outperforms baselines, achieving the highest No Collision (NC) rate of 98.4 among all evaluated methods.

自动驾驶视觉语言动作规划模型解耦

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。