让视觉语言动作模型提前预判碰撞,主动避障而非事后反应。
Neuro-Symbolic Safety Guidance for Vision-Language-Action Models via Constrained Flow Matching

- 在流匹配过程中插入符号约束,动态修正轨迹以预防碰撞。
- 在SafeLIBERO上实现82.8%避障率与81.6%任务成功率,长程任务提升显著。
- 适合需要高安全性的机器人操作场景,尤其长时序任务。
视觉-语言-动作(VLA)模型在机器人操作任务中展现出良好的泛化能力,但其实际部署受限于缺乏有效的安全机制。现有方法仅能防止机器人下一步动作引发的碰撞。本文提出一种基于流匹配的神经符号安全引导机制,实现预测性碰撞规避。基于流匹配的VLA通过迭代神经流匹配过程预测轨迹(一系列动作)。本方法将安全约束建模为最小范数约束优化问题,在去噪过程中修正安全违规。通过分析预测轨迹并实时修正,方法可在碰撞不可避免前即进行干预。该符号约束与神经轨迹生成的交替融合,实现了预测性避障而非被动响应。在SafeLIBERO基准测试中,本方法达到82.8%的避障率和81.6%的任务成功率,分别比单步方法提升6.3%和19.8%,尤其在长时序任务中优势明显,因分布偏移累积效应更显著。视频演示见项目页面:https://willenglish.tech/SafetyGuidedFlowMatching/。
原文摘要 · Abstract (English)
Vision-Language-Action (VLA) models have demonstrated promising generalization capabilities across robotic manipulation tasks, yet their real-world deployment remains limited by the lack of effective safety measures. Specifically, existing safety measures only prevent collisions caused by the robot's next action. In this paper, we propose a neuro-symbolic safety guidance mechanism for flow matching based VLAs that enables predictive collision avoidance. Flow matching based VLAs determine the next actions by predicting a trajectory (a sequence of actions) through an iterative neural flow matching process. Our method formulates safety enforcement as a minimum-norm constrained optimization problem that corrects safety violations during the denoising process of noisy intermediate trajectory predictions. By analyzing predicted trajectories and applying corrections during iterative denoising, our approach anticipates collisions before they become unavoidable. This interleaving of symbolic constraint satisfaction with neural trajectory generation enables predictive collision avoidance rather than reactive intervention. On the SafeLIBERO benchmark, our method achieves 82.8% collision avoidance and 81.6% task success, a 6.3% and 19.8% improvement respectively over single-step methods, with the largest gains on long-horizon tasks where compounding distribution shift is most pronounced. Video demonstrations of our approach are included on our project page at https://willenglish.tech/SafetyGuidedFlowMatching/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。