真实环境测试AI代理在多种输入下的间接提示注入漏洞
LivePI: More Realistic Benchmarking of Agents Against Indirect Prompt Injection

- 构建真实虚拟机环境,模拟邮件、聊天等七类输入的攻击场景
- 五种恶意目标中成功率10.7%至29.6%,群聊注入全成功
- 提出双层防御机制,可拦截所有恶意操作且不影响正常任务
AI代理如OpenClaw在本地工作流中越来越多地接入外部工具,带来间接提示注入(IPI)风险:代理可能执行嵌入在未信任输入(如邮件、下载文件、网页、代码仓库或群聊消息)中的有害指令。现有评估多为小规模、纯模拟或局限于特定通道。我们提出LivePI(Live Prompt Injection),一个在生产级但受控环境中结构化的IPI风险基准。LivePI涵盖七类输入界面、十二种攻击/渲染类型和五种恶意目标,包括敏感信息窃取、未经授权的安全控制变更、危险代码获取或执行、收件箱摘要泄露及加密货币转账。我们在真实虚拟机上运行,集成实时但可控的邮件、聊天、网页、本地文件、代码仓库和钱包接口。GPT-5.3-Codex、Claude Opus 4.6、Gemini 3.1 Pro、Kimi K2.5和GLM-5的总攻击成功率介于10.7%至29.6%之间。群聊注入在所有测试模型中均成功,代码仓库链接攻击虽样本少但导致高危失败。我们还评估了两层防御:提示层过滤与执行前工具调用授权。在GPT-5.3-Codex设置下,该防御在执行前拦截所有测试恶意目标完成,同时在PinchBench衍生负载上保持良性功能。
原文摘要 · Abstract (English)
AI agents such as OpenClaw are increasingly deployed in local workflows with access to external tools. This creates indirect prompt-injection (IPI) risk: an agent may execute harmful instructions embedded in untrusted inputs such as email, downloaded files, webpages, repositories, or group-chat messages. Existing evaluations are often small, purely simulated, or focused on a narrow set of channels. We introduce LivePI (Live Prompt Injection), a structured benchmark for IPI risk in a production-like but test-controlled environment. LivePI covers seven input surfaces, twelve attack/rendering families, and five malicious goals, including protected-information exfiltration, unauthorized security-control changes, unsafe code retrieval or execution, inbox-summary exfiltration, and cryptocurrency transfer. We run LivePI on a real virtual machine with live but test-controlled email, chat, web, local-file, repository, and wallet interfaces. Across GPT-5.3-Codex, Claude Opus 4.6, Gemini 3.1 Pro, Kimi K2.5, and GLM-5, total attack success rates range from 10.7% to 29.6%. Group-chat injection is uniformly successful across the evaluated backbones in our deployment, and repository-link attacks produce high-severity failures despite a small denominator. We also evaluate a two-layer defense consisting of prompt-level filtering and pre-execution tool-call authorization. In the GPT-5.3-Codex setting, the defense intercepts all tested malicious-goal completions in LivePI before execution while preserving benign utility on PinchBench-derived workloads.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。