arXiv:2511.21663cs.CVcs.AI2025-11被引 8

提出轻量级稀疏攻击法,精准干扰视觉-语言-动作模型决策。

Attention-Guided Patch-Wise Sparse Adversarial Attacks on Vision-Language-Action Models

  • 在视觉编码特征投影空间直接加扰动,无需全程训练。
  • 90%以上图像区域未被扰动,攻击成功率接近100%。
  • 单步耗时仅0.06秒,适合实际场景快速验证漏洞。

近年来,具身智能中的视觉-语言-动作(VLA)模型发展迅速。然而,现有对抗攻击方法需昂贵的端到端训练,且常产生明显扰动块。为此,我们提出ADVLA框架,直接在视觉编码器投影至文本特征空间的特征上施加对抗扰动。ADVLA在低幅值约束下高效破坏下游动作预测,注意力引导使扰动聚焦且稀疏。我们引入三种策略增强敏感性、强制稀疏性并集中扰动。实验表明,在$ L_{\

原文摘要 · Abstract (English)

In recent years, Vision-Language-Action (VLA) models in embodied intelligence have developed rapidly. However, existing adversarial attack methods require costly end-to-end training and often generate noticeable perturbation patches. To address these limitations, we propose ADVLA, a framework that directly applies adversarial perturbations on features projected from the visual encoder into the textual feature space. ADVLA efficiently disrupts downstream action predictions under low-amplitude constraints, and attention guidance allows the perturbations to be both focused and sparse. We introduce three strategies that enhance sensitivity, enforce sparsity, and concentrate perturbations. Experiments demonstrate that under an $L_{\infty}=4/255$ constraint, ADVLA combined with Top-K masking modifies less than 10% of the patches while achieving an attack success rate of nearly 100%. The perturbations are concentrated on critical regions, remain almost imperceptible in the overall image, and a single-step iteration takes only about 0.06 seconds, significantly outperforming conventional patch-based attacks. In summary, ADVLA effectively weakens downstream action predictions of VLA models under low-amplitude and locally sparse conditions, avoiding the high training costs and conspicuous perturbations of traditional patch attacks, and demonstrates unique effectiveness and practical value for attacking VLA feature spaces.

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。