通过语言特征诱导多模态大模型陷入无限生成循环,耗尽计算资源。
LingoLoop Attack: Trapping MLLMs via Linguistic Context and State Entrapment into Endless Loops
- 利用词性信息动态调整注意力,延迟结束符生成
- 通过限制隐状态幅度,强制模型产生重复输出循环
- 在测试中使输出量最多增加367倍,适用于安全评估
多模态大语言模型(MLLMs)虽具潜力,但推理时需大量计算资源。攻击者可借机诱发过度输出,导致资源耗尽与服务降级。现有能量-延迟攻击仅粗略改变输出分布以延长生成时间,却忽视了词性(POS)特征对结束符(EOS)生成的影响及句级结构对输出数量的作用,限制了攻击效果。为此,我们提出LingoLoop攻击,旨在诱导MLLM生成冗长且重复的序列。首先,发现词性标签显著影响EOS生成概率,据此设计基于词性的延迟机制,通过引导注意力权重推迟EOS生成。其次,识别出限制输出多样性可有效引发持续循环,提出生成路径剪枝机制,通过抑制隐藏状态幅度,促使模型陷入重复生成。在Qwen2.5-VL-3B等模型上的实验表明,LingoLoop能持续将模型逼至生成上限;当上限放宽时,输出长度可达干净输入的367倍,引发相应能耗激增。该研究揭示了MLLMs的关键脆弱性,对其可靠部署构成挑战。
原文摘要 · Abstract (English)
Multimodal Large Language Models (MLLMs) have shown great promise but require substantial computational resources during inference. Attackers can exploit this by inducing excessive output, leading to resource exhaustion and service degradation. Prior energy-latency attacks aim to increase generation time by broadly shifting the output token distribution away from the EOS token, but they neglect the influence of token-level Part-of-Speech (POS) characteristics on EOS and sentence-level structural patterns on output counts, limiting their efficacy. To address this, we propose LingoLoop, an attack designed to induce MLLMs to generate excessively verbose and repetitive sequences. First, we find that the POS tag of a token strongly affects the likelihood of generating an EOS token. Based on this insight, we propose a POS-Aware Delay Mechanism to postpone EOS token generation by adjusting attention weights guided by POS information. Second, we identify that constraining output diversity to induce repetitive loops is effective for sustained generation. We introduce a Generative Path Pruning Mechanism that limits the magnitude of hidden states, encouraging the model to produce persistent loops. Extensive experiments on models like Qwen2.5-VL-3B demonstrate LingoLoop's powerful ability to trap them in generative loops; it consistently drives them to their generation limits and, when those limits are relaxed, can induce outputs with up to 367x more tokens than clean inputs, triggering a commensurate surge in energy consumption. These findings expose significant MLLMs' vulnerabilities, posing challenges for their reliable deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。