AI攻击升级:提示注入与网络漏洞结合,突破传统安全防线
Prompt Injection 2.0: Hybrid AI Threats
- 将提示注入与XSS/CSRF等网络漏洞结合,形成新型混合攻击
- 实测显示传统防火墙、令牌机制对AI增强攻击无效
- 提出隔离+权限分离+实时检测的综合防护架构
提示注入攻击通过恶意输入诱导大模型违背原指令执行非法操作,自2022年发现以来持续威胁大模型集成系统。随着代理型AI系统发展,大模型可自主调用工具、协同执行多步任务,攻击面显著扩大。本文分析了提示注入2.0——即提示注入与跨站脚本(XSS)、跨站请求伪造(CSRF)等传统网络安全漏洞结合形成的混合攻击,能系统性绕过常规安全措施。研究基于Preamble早期工作,评估其防御技术在应对现代威胁(如AI蠕虫、多代理感染、人机协同攻击)中的有效性,并引入最新基准测试数据,验证传统Web应用防火墙、XSS过滤器及CSRF令牌在面对增强型攻击时的失效。同时提出融合提示隔离、运行时安全与权限分离的新架构,配备创新威胁检测能力。
原文摘要 · Abstract (English)
Prompt injection attacks, where malicious input is designed to manipulate AI systems into ignoring their original instructions and following unauthorized commands instead, were first discovered by Preamble, Inc. in May 2022 and responsibly disclosed to OpenAI. Over the last three years, these attacks have continued to pose a critical security threat to LLM-integrated systems. The emergence of agentic AI systems, where LLMs autonomously perform multistep tasks through tools and coordination with other agents, has fundamentally transformed the threat landscape. Modern prompt injection attacks can now combine with traditional cybersecurity exploits to create hybrid threats that systematically evade traditional security controls. This paper presents a comprehensive analysis of Prompt Injection 2.0, examining how prompt injections integrate with Cross-Site Scripting (XSS), Cross-Site Request Forgery (CSRF), and other web security vulnerabilities to bypass traditional security measures. We build upon Preamble's foundational research and mitigation technologies, evaluating them against contemporary threats, including AI worms, multi-agent infections, and hybrid cyber-AI attacks. Our analysis incorporates recent benchmarks that demonstrate how traditional web application firewalls, XSS filters, and CSRF tokens fail against AI-enhanced attacks. We also present architectural solutions that combine prompt isolation, runtime security, and privilege separation with novel threat detection capabilities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。