用物理物体做触发器,让视觉语言动作模型执行特定指令。
Goal-oriented Backdoor Attack against Vision-Language-Action Models via Physical Objects
- 用真实物品作触发器,悄悄植入恶意指令。
- 有触发器时97%情况下能成功执行目标动作,无触发时性能不变。
- 适合研究机器人安全或对抗攻击的学者参考。
视觉语言动作(VLA)模型虽提升机器人理解与执行能力,但依赖未清理训练数据带来安全隐患。现有后门攻击多需白盒访问,且仅导致任务失败。本文提出目标导向后门攻击(GoBA),通过在训练集中注入物理物体作为触发器,使模型在正常情况下表现如常,一旦检测到特定物理触发器便执行预设目标动作。基于主流基准LIBERO,构建含多种物理触发器和目标动作的BadLIBERO数据集。设计三级评估体系,将模型行为分为‘无操作’、‘尝试执行’和‘成功执行’三类。实验表明,当触发器存在时,模型在97%输入中成功达成后门目标,且对干净输入无性能下降。进一步分析显示,动作轨迹与触发器颜色显著影响攻击效果,而尺寸影响较小。代码与数据集已公开于https://goba-attack.github.io/。
原文摘要 · Abstract (English)
Recent advances in vision-language-action (VLA) models have greatly improved embodied AI, enabling robots to follow natural language instructions and perform diverse tasks. However, their reliance on uncurated training datasets raises serious security concerns. Existing backdoor attacks on VLAs mostly assume white-box access and result in task failures instead of enforcing specific actions. In this work, we reveal a more practical threat: attackers can manipulate VLAs by simply injecting physical objects as triggers into the training dataset. We propose goal-oriented backdoor attacks (GoBA), where the VLA behaves normally in the absence of physical triggers but executes predefined and goal-oriented actions in the presence of physical triggers. Specifically, based on a popular VLA benchmark LIBERO, we introduce BadLIBERO that incorporates diverse physical triggers and goal-oriented backdoor actions. In addition, we propose a three-level evaluation that categorizes the victim VLA's actions under GoBA into three states: nothing to do, try to do, and success to do. Experiments show that GoBA enables the victim VLA to successfully achieve the backdoor goal in 97 percentage of inputs when the physical trigger is present, while causing zero performance degradation on clean inputs. Finally, by investigating factors related to GoBA, we find that the action trajectory and trigger color significantly influence attack performance, while trigger size has surprisingly little effect. The code and BadLIBERO dataset are accessible via the project page at https://goba-attack.github.io/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。