用微小文本修改让视觉语言动作模型执行错误,揭示机器人安全漏洞。
SABER: A Stealthy Agentic Black-Box Attack Framework for Vision-Language-Action Models
- 构建智能体式攻击框架,通过字符、词元级工具生成隐蔽指令扰动。
- 在六个主流模型上使任务成功率下降20.6%,动作序列变长55%。
- 比基线少用54.7%字符修改,适合评估机器人系统的抗攻击能力。
视觉语言动作(VLA)模型使机器人能根据自然语言指令执行任务,但指令通道也引入了关键漏洞:微小的文本扰动即可改变机器人行为。为系统评估鲁棒性,需一种能在多种VLA模型上生成最小且有效的指令修改的黑盒攻击者。为此,我们提出SABER,一种基于智能体的自动攻击框架,在有限编辑预算下生成目标性行为退化。SABER使用GRPO训练的ReAct攻击者,结合字符、词元和提示级工具,在受限编辑预算内生成小而合理的指令扰动,导致任务失败、执行时间过长及约束违反增加。在六个先进VLA模型上的LIBERO基准测试中,SABER使任务成功率下降20.6%,动作序列长度增加55%,约束违反率上升33%,同时比强基线减少21.1%的工具调用和54.7%的字符修改。结果表明,微小且自然的指令修改足以显著破坏机器人执行,而该智能体式黑盒流程为红队测试机器人基础模型提供了高效、可扩展且自适应的方法。代码已公开于 https://github.com/wuxiyang1996/SABER。
原文摘要 · Abstract (English)
Vision-language-action (VLA) models enable robots to follow natural-language instructions grounded in visual observations, but the instruction channel also introduces a critical vulnerability: small textual perturbations can alter downstream robot behavior. Systematic robustness evaluation therefore requires a black-box attacker that can generate minimal yet effective instruction edits across diverse VLA models. To this end, we present SABER, an agent-centric approach for automatically generating instruction-based adversarial attacks on VLA models under bounded edit budgets. SABER uses a GRPO-trained ReAct attacker to generate small, plausible adversarial instruction edits using character-, token-, and prompt-level tools under a bounded edit budget that induces targeted behavioral degradation, including task failure, unnecessarily long execution, and increased constraint violations. On the LIBERO benchmark across six state-of-the-art VLA models, SABER reduces task success by 20.6%, increases action-sequence length by 55%, and raises constraint violations by 33%, while requiring 21.1% fewer tool calls and 54.7% fewer character edits than strong GPT-based baselines. These results show that small, plausible instruction edits are sufficient to substantially degrade robot execution, and that an agentic black-box pipeline offers a practical, scalable, and adaptive approach for red-teaming robotic foundation models. The codebase is publicly available at https://github.com/wuxiyang1996/SABER.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。