arXiv:2603.13782cs.ROcs.CV2026-03被引 3

只需监控模型内少数注意力头,就能实时发现导航错误并自动修正。

Your Vision-Language-Action Model Already Has Attention Heads For Path Deviation Detection

  • 从冻结的视觉语言动作模型中挖掘出专门感知路径偏差的注意力头。
  • 仅用三个注意力头即实现44.6%的偏差检测率,误报率仅11.7%。
  • 无需训练,可部署于真实机器人,适合需要高安全性的自主导航场景。

视觉语言动作(VLA)模型在导航任务中展现出强大的语义动作预测能力,能融合复杂语言指令与视觉上下文进行推理。然而,其易受视觉推理幻觉影响,导致轨迹偏离。传统方法需额外训练批判模块或依赖复杂不确定性启发式策略。本文发现,在一个冻结的VLA模型中,监测少数注意力头即可无额外计算开销地准确检测路径偏差。这些头被称为导航头,天然捕捉历史视觉序列与语言指令间的时空因果关系。基于此,我们提出一种无需训练的异常检测框架,实时监控导航头信号以识别幻觉。令人惊讶的是,从上千个注意力头中筛选出的三个组合,便能在测试中达到44.6%的偏差检测率,且误报率仅为11.7%。一旦检测到偏差,系统将绕过重型VLA模型,触发轻量级强化学习(RL)策略执行最短路径回滚。该检测-恢复全流程已成功部署于物理机器人,验证了其实际鲁棒性。所有代码将公开。

原文摘要 · Abstract (English)

Vision-Language-Action (VLA) models have demonstrated strong potential for predicting semantic actions in navigation tasks, demonstrating the ability to reason over complex linguistic instructions and visual contexts. However, they are fundamentally hindered by visual-reasoning hallucinations that lead to trajectory deviations. Addressing this issue has conventionally required training external critic modules or relying on complex uncertainty heuristics. In this work, we discover that monitoring a few attention heads within a frozen VLA model can accurately detect path deviations without incurring additional computational overhead. We refer to these heads, which inherently capture the spatiotemporal causality between historical visual sequences and linguistic instructions, as Navigation Heads. Using these heads, we propose an intuitive, training-free anomaly-detection framework that monitors their signals to detect hallucinations in real time. Surprisingly, among over a thousand attention heads, a combination of just three is sufficient to achieve a 44.6 % deviation detection rate with a low false-positive rate of 11.7 %. Furthermore, upon detecting a deviation, we bypass the heavy VLA model and trigger a lightweight Reinforcement Learning (RL) policy to safely execute a shortest-path rollback. By integrating this entire detection-to-recovery pipeline onto a physical robot, we demonstrate its practical robustness. All source code will be publicly available.

导航注意力头异常检测机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。