通过微调图像诱导视觉语言模型生成超长低效文本,提升攻击效果。
An Image Is Worth Ten Thousand Words: Verbose-Text Induction Attacks on VLMs
- 分两阶段优化:先找能引发长文本的提示词,再生成视觉上几乎不变的对抗样本。
- 在四个主流VLM上实测,输出长度提升最高达4.3倍,且保持输入不可察觉。
- 适用于评估VLM部署风险,尤其对注重效率与成本的应用场景有警示意义。
随着视觉语言模型(VLMs)在多模态任务中取得显著成功,其部署效率问题日益突出,生成过程消耗的令牌数量已成为关键评估指标。已有研究发现,特定输入可诱导VLM生成冗长但信息密度低的输出,显著增加能耗、延迟和令牌成本。然而,现有方法仅通过延迟结束标记(EOS)来间接延长输出,缺乏对输出长度的显式优化目标,稳定性与可控性不足。为此,本文提出一种新型的冗长文本诱导攻击(VTIA),通过两阶段框架,在良性图像中注入难以察觉的对抗扰动,以优化并最大化扰动后图像的输出令牌数。首先,采用强化学习策略自动搜索能触发大语言模型(LLM)生成冗长输出的对抗提示词;随后,进行视觉对齐的扰动优化,使扰动图像的视觉嵌入与对抗提示词的嵌入高度相似,从而构造出能引发冗长文本生成的恶意图像。在四个主流VLM上的全面实验表明,该方法在有效性、效率和泛化能力方面均表现出显著优势。
原文摘要 · Abstract (English)
With the remarkable success of Vision-Language Models (VLMs) on multimodal tasks, concerns regarding their deployment efficiency have become increasingly prominent. In particular, the number of tokens consumed during the generation process has emerged as a key evaluation metric.Prior studies have shown that specific inputs can induce VLMs to generate lengthy outputs with low information density, which significantly increases energy consumption, latency, and token costs. However, existing methods simply delay the occurrence of the EOS token to implicitly prolong output, and fail to directly maximize the output token length as an explicit optimization objective, lacking stability and controllability.To address these limitations, this paper proposes a novel verbose-text induction attack (VTIA) to inject imperceptible adversarial perturbations into benign images via a two-stage framework, which identifies the most malicious prompt embeddings for optimizing and maximizing the output token of the perturbed images.Specifically, we first perform adversarial prompt search, employing reinforcement learning strategies to automatically identify adversarial prompts capable of inducing the LLM component within VLMs to produce verbose outputs. We then conduct vision-aligned perturbation optimization to craft adversarial examples on input images, maximizing the similarity between the perturbed image's visual embeddings and those of the adversarial prompt, thereby constructing malicious images that trigger verbose text generation. Comprehensive experiments on four popular VLMs demonstrate that our method achieves significant advantages in terms of effectiveness, efficiency, and generalization capability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。