arXiv:2604.18486cs.CVcs.CL2026-04被引 5

让视觉语言模型一步完成推理与规划,速度超传统方法。

Xiaomi OneVL: One-Step Latent Reasoning and Planning with Vision-Language Explanation

论文配图:Xiaomi OneVL: One-Step Latent Reasoning and Planning with Vision-Language Explanation
图 1 · 摘自论文原文
  • 用双解码器监督潜空间,融合语言和视觉世界模型
  • 在四个基准上首次超越显式推理,且推理速度与答案生成相当
  • 适合需要实时推理的自动驾驶系统开发

链式思维(CoT)推理在基于视觉-语言代理(VLA)的自动驾驶轨迹预测中表现强劲,但其自回归特性带来高延迟,难以实现实时部署。潜在式CoT方法试图通过将推理压缩到连续隐状态来缓解这一问题,但始终无法超越显式方法。我们认为原因在于纯语言的潜表示仅压缩了世界的符号抽象,而非实际驱动驾驶的因果动态。为此,我们提出OneVL(一步潜式推理与规划,带视觉-语言解释),一个统一的VLA与世界模型框架,通过由双重辅助解码器监督的紧凑潜标记进行推理。除了重建文本CoT的语言解码器外,还引入视觉世界模型解码器,用于预测未来帧的潜表示,迫使潜空间内化道路几何、行为主体运动及环境变化的因果动态。采用三阶段训练流程,逐步对齐潜表示与轨迹、语言和视觉目标,确保稳定联合优化。推理时,辅助解码器被丢弃,所有潜标记一次性并行填充,达到仅输出答案的推理速度。在四个基准上,OneVL成为首个超越显式CoT的潜式方法,在答案仅输出延迟下实现更高精度。结果表明,借助世界模型监督,潜式CoT可生成比逐词冗长推理更具泛化能力的表示。代码已开源。

原文摘要 · Abstract (English)

Chain-of-Thought (CoT) reasoning has become a powerful driver of trajectory prediction in VLA-based autonomous driving, yet its autoregressive nature imposes a latency cost that is prohibitive for real-time deployment. Latent CoT methods attempt to close this gap by compressing reasoning into continuous hidden states, but consistently fall short of their explicit counterparts. We suggest that this is due to purely linguistic latent representations compressing a symbolic abstraction of the world, rather than the causal dynamics that actually govern driving. Thus, we present OneVL (One-step latent reasoning and planning with Vision-Language explanations), a unified VLA and World Model framework that routes reasoning through compact latent tokens supervised by dual auxiliary decoders. Alongside a language decoder that reconstructs text CoT, we introduce a visual world model decoder that predicts future-frame tokens, forcing the latent space to internalize the causal dynamics of road geometry, agent motion, and environmental change. A three-stage training pipeline progressively aligns these latents with trajectory, language, and visual objectives, ensuring stable joint optimization. In inference, the auxiliary decoders are discarded, and all latent tokens are prefilled in a single parallel pass, matching the speed of answer-only prediction. Across four benchmarks, OneVL becomes the first latent CoT method to surpass explicit CoT, delivering superior accuracy at answer-only latency. These results show that with world model supervision, latent CoT produces more generalizable representations than verbose token-by-token reasoning. Code has been open-sourced to the community. Project Page: https://xiaomi-embodied-intelligence.github.io/OneVL

自动驾驶视觉语言潜空间推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。