用模糊测试发现大模型服务系统的隐蔽漏洞,15个漏洞已确认并获2个CVE认证。
Continuous Discovery of Vulnerabilities in LLM Serving Systems with Fuzzing

- 将多请求时序轨迹作为输入,通过轻量级检测器捕捉崩溃、卡死等异常
- 在vLLM和SGLang中发现15个漏洞,包括跨请求污染和性能干扰等严重问题
- 适合关注大模型服务安全与可靠性的人,尤其系统开发者和安全研究员
大模型推理与服务系统已成为关键基础设施,但许多严重故障源于服务层而非模型本身。现代推理引擎结合了键值缓存、批处理、前缀共享、推测解码、适配器及多租户调度,形成在真实并发负载下才显现的共享状态行为,常规模型、安全与API测试难以覆盖。我们提出GRIEF,一种灰盒模糊测试工具,将带时序的多请求轨迹作为首类输入,利用轻量级判据检测崩溃、卡死、性能异常及静默输出错误,并通过受控重放与对数概率校验确认可复现的服务层缺陷。在vLLM和SGLang早期测试中,GRIEF发现15个漏洞,其中10个经开发团队确认,包含2个CVE,涵盖键值缓存隔离失败、跨请求性能干扰以及崩溃或存活性缺陷。结果表明,并发、缓存与状态重用可能引发静默跨请求污染、噪声邻居拒绝服务及无畸形输入的延迟崩溃,使并发服务行为成为大模型基础设施的一级安全与可靠性边界。
原文摘要 · Abstract (English)
LLM inference and serving systems have become security-critical infrastructure; however, many of their most concerning failures arise from the serving layer rather than from model behavior alone. Modern inference engines combine KV cache, batching, prefix sharing, speculative decoding, adapters, and multi-tenant scheduling, creating shared-state behavior that only emerges under realistic concurrent workloads and is missed by standard model, safety, and API tests. We present GRIEF, a greybox fuzzer for LLM inference engines that treats timed multi-request traces as first-class inputs, uses lightweight oracles to detect crashes, hangs, performance pathologies, and silent output corruption, and applies controlled replay with log-probability checks to confirm reproducible serving-layer failures. Across early campaigns on vLLM and SGLang, GRIEF discovers 15 vulnerabilities, 10 confirmed by engine developers, including 2 CVEs, spanning KV-cache isolation failures, cross-request performance interference, and crash or liveness bugs. These results show that concurrency, caching, and state reuse can induce silent cross-request contamination, noisy-neighbor denial of service, and delayed crashes without malformed inputs or explicit server errors, making concurrent serving behavior a first-class security and reliability boundary for LLM infrastructure.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。