arXiv:2606.24759cs.CVcs.AI2026-06

UniDrive融合时序与高分辨率感知,提升自动驾驶风险理解的准确性与可解释性。

UniDrive: A Unified Vision-Language and Grounding Framework for Interpretable Risk Understanding in Autonomous Driving

论文配图:UniDrive: A Unified Vision-Language and Grounding Framework for Interpretable Risk Understanding in Autonomous Driving
图 1 · 摘自论文原文
  • 双分支结构:时序推理+高分辨率感知,动态与细节兼得
  • 在DRAMA基准上实现最佳图文描述与小目标定位性能
  • 支持零样本迁移,人类评估显示解释更可信

近期多模态大模型在自动驾驶场景理解中展现潜力,但现有方法仍面临时序推理与空间精度之间的根本权衡。依赖单帧或低分辨率输入的模型常遗漏细小、远距离或部分遮挡的风险,而以语言为中心的模型则缺乏可解释的视觉证据。为此,我们提出UniDrive——一个统一的视觉-语言与定位框架,用于可解释的自动驾驶风险理解。UniDrive结合多帧输入的时序推理分支与最新帧的高分辨率感知分支,通过门控交叉注意力模块融合,使动态上下文与精确空间证据对齐。基于融合表示,统一生成自然语言风险描述和风险物体的边界框输出。在DRAMA-Reasoning基准上的实验表明,UniDrive在图像与视频基线中均表现最优,尤其在小目标定位、零样本迁移至NuScenes与BDD100K,以及人类评估的可解释性与可信度方面优势显著。结果表明,显式结合时序语义与高分辨率感知,为可解释且安全导向的自动驾驶系统提供了更强基础。代码已开源。

原文摘要 · Abstract (English)

Recent multimodal large language models (MLLMs) have shown strong potential for autonomous driving scene understanding, yet existing methods still face a fundamental trade-off between temporal reasoning and spatial precision. Models that rely on single-frame or low-resolution inputs often miss small, distant, or partially occluded hazards, while language-centric driving models frequently provide limited grounded evidence for their explanations. To address this gap, we propose UniDrive, a unified visual-language and grounding framework for interpretable risk understanding in autonomous driving. UniDrive combines a temporal reasoning branch that models scene dynamics from multi-frame visual input with a high-resolution perception branch that preserves fine-grained spatial details from the latest frame. The two branches are integrated through a gated cross-attention fusion module, enabling dynamic context to be aligned with precise spatial evidence. Based on the fused representation, UniDrive jointly generates natural-language risk descriptions and grounded bounding-box outputs for risk objects. Experiments on the DRAMA-Reasoning benchmark show that UniDrive outperforms representative image-based and video-based baselines in both captioning and risk-object grounding. In particular, UniDrive achieves the best overall performance on the validation split and demonstrates clear advantages in small-object localization, zero-shot generalization to NuScenes and BDD100K, and human-rated interpretability and trustworthiness. These results suggest that explicitly combining temporal semantics and high-resolution perception provides a stronger foundation for interpretable and safety-oriented autonomous driving systems. The code is available at https://github.com/pixeli99/unidrive-dev.

自动驾驶多模态可解释性视觉语言

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。