攻击大模型服务系统调度机制,实现更低成本的高延迟破坏。
Rethinking Latency Denial-of-Service: Attacking the LLM Serving Framework, Not the Model
- 通过填满缓存和强制抢占,干扰调度器状态切换
- 黑盒攻击下平均首令牌耗时提升20-280倍,代价降低30%-40%
- 揭示现代系统优化可抵御算法级攻击,但调度层仍脆弱
大型语言模型面临日益严重的延迟攻击威胁。由于推理成本高昂,轻微延迟即可导致巨大运营开销与可用性风险。现有研究多聚焦于通过构造输入触发最坏情况输出长度的算法复杂度攻击,但我们发现此类攻击在现代大模型服务系统中效果有限。原因在于系统级优化如连续批处理提供了逻辑隔离,缓解了共驻用户间的延迟传染。为此,本文转向系统层,提出新型「填满与挤压」攻击策略,针对调度器状态转换进行攻击。「填满」先耗尽全局键值缓存,引发队首阻塞;「挤压」则迫使系统陷入重复抢占。通过从简单文本提示到复杂提示工程的方法控制输出长度,并结合内存状态侧信道探测,可在黑盒环境下以更低成本实施攻击。大量实验表明,该攻击使首令牌时间平均延长20–280倍,每输出令牌时间延长1.5–4倍,且攻击成本比现有方法低30%–40%。
原文摘要 · Abstract (English)
Large Language Models face an emerging and critical threat known as latency attacks. Because LLM inference is inherently expensive, even modest slowdowns can translate into substantial operating costs and severe availability risks. Recently, a growing body of research has focused on algorithmic complexity attacks by crafting inputs to trigger worst-case output lengths. However, we report a counter-intuitive finding that these algorithmic latency attacks are largely ineffective against modern LLM serving systems. We reveal that system-level optimization such as continuous batching provides a logical isolation to mitigate contagious latency impact on co-located users. To this end, in this paper, we shift the focus from the algorithm to the system layer, and introduce a new Fill and Squeeze attack strategy targeting the state transition of the scheduler. "Fill" first exhausts the global KV cache to induce Head-of-Line blocking, while "Squeeze" forces the system into repetitive preemption. By manipulating output lengths using methods from simple plain-text prompts to more complex prompt engineering, and leveraging side-channel probing of memory status, we demonstrate that the attack can be orchestrated in a black-box setting with much less cost. Extensive evaluations indicate by up to 20-280x average slowdown on Time to First Token and 1.5-4x average slowdown on Time Per Output Token compared to existing attacks with 30-40% lower attack cost.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。