arXiv:2606.09749cs.ROcs.LG2026-06

利用视觉语言动作模型的注意力机制实现无需训练的实时避障。

Your Model Already Knows: Attention-Guided Safety Filter for Vision-Language-Action Models

论文配图:Your Model Already Knows: Attention-Guided Safety Filter for Vision-Language-Action Models
图 1 · 摘自论文原文
  • 从模型注意力头中提取目标位置,无需额外调用VLM
  • 动态障碍物场景下避障成功率比基线高43%
  • 适合需要实时安全控制的机器人任务

视觉语言动作(VLA)模型在多种机器人操作任务中表现出色,但无法保证不与场景中无关物体发生碰撞。现有安全过滤器依赖视觉语言模型(VLM)识别障碍物及其位置,但速度过慢,仅能在任务初始化时使用,无法追踪移动障碍物。我们发现VLA模型中少数注意力头能稳定定位策略意图接近的目标。基于此,提出一种免训练的安全框架:每步从注意力头获取主动目标,将其余场景视为障碍物,并输入控制屏障函数(CBF)滤波器。结合轻量级实时物体追踪器,可实现对非静态障碍物的避障。我们在扩展了动态障碍物的SafeLIBERO上评估该方法。在原始静态基准上,性能与使用模拟器状态的“理想”基线相当;在动态场景中,当理想基线因初始目标失效而表现下降时,本方法平均高出43%。结果表明,实时安全过滤所需的感知信号已存在于VLA模型中,无需额外训练或复杂辅助模型。

原文摘要 · Abstract (English)

Vision-Language-Action (VLA) models have demonstrated impressive end-to-end performance across a variety of robotic manipulation tasks. However, these policies offer no guarantees against collisions with task-irrelevant objects in the scene. Existing safety filters sidestep this problem by querying a vision-language model (VLM) to identify obstacles and their locations. This, however, is too slow to run in the control loop and can only be invoked at episode initialization, leaving the filter unable to track moving obstacles. We discover that a small number of attention heads within a VLA model reliably localize the object the policy intends to approach. These heads can be exploited within a training-free safety framework that obtains the active target from the attention heads at every step, treats the remainder of the scene as obstacles, and feeds these into a Control Barrier Function (CBF) filter. Together with a lightweight real-time object tracker, this allows for collision avoidance for non-static obstacles. We evaluate our framework on SafeLIBERO, which we extend with moving obstacles. On the original static benchmark, our method performs comparably to an oracle that uses privileged simulator state to identify the target, emulating a VLM-based identification step run once at episode initialization. On the dynamic variant, where the oracle's init-time target assignment becomes stale, our method substantially outperforms it by 43%, on average. Our findings suggest that the perceptual signals needed for real-time safety filtering are already present within VLA policies and can be exploited without additional training or heavy auxiliary models.

机器人安全控制注意力机制避障

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。