用进化算法自动发现并优化针对大模型网页代理的攻击策略
Genesis: Evolving Attack Strategies for LLM Web Agent Red-Teaming
- 结合遗传算法与混合策略表示生成对抗性注入
- 在多种网页任务中持续发现新攻击策略,性能超越现有基线
- 适合安全研究者、红队测试人员及对抗训练开发者
随着大语言模型(LLM)代理越来越多地自动化复杂网页任务,它们虽提升了生产力,但也引入了新的安全风险。然而,针对网页代理攻击的相关研究仍有限。现有红队测试方法主要依赖人工设计攻击策略或离线训练的静态模型,难以捕捉网页代理的行为模式,导致跨环境泛化能力差。在网页代理攻击中,成功依赖于攻击策略的持续发现与演化。为此,我们提出Genesis,一个由三个模块组成的智能体框架:攻击者(Attacker)、评分器(Scorer)和策略师(Strategist)。攻击者通过融合遗传算法与混合策略表示生成对抗性注入;评分器评估目标网页代理的响应以提供反馈;策略师从交互日志中动态挖掘有效策略,并构建持续增长的策略库,再重新部署以提升攻击者效能。在多种网页任务上的大量实验表明,该框架能持续发现新策略,且性能显著优于现有攻击基线。代码已开源:https://github.com/CjangCjengh/web_agent_attack。
原文摘要 · Abstract (English)
As large language model (LLM) agents increasingly automate complex web tasks, they boost productivity while simultaneously introducing new security risks. However, relevant studies on web agent attacks remain limited. Existing red-teaming approaches mainly rely on manually crafted attack strategies or static models trained offline. Such methods fail to capture the underlying behavioral patterns of web agents, making it difficult to generalize across diverse environments. In web agent attacks, success requires the continuous discovery and evolution of attack strategies. To this end, we propose Genesis, a novel agentic framework composed of three modules: Attacker, Scorer, and Strategist. The Attacker generates adversarial injections by integrating the genetic algorithm with a hybrid strategy representation. The Scorer evaluates the target web agent's responses to provide feedback. The Strategist dynamically uncovers effective strategies from interaction logs and compiles them into a continuously growing strategy library, which is then re-deployed to enhance the Attacker's effectiveness. Extensive experiments across various web tasks show that our framework discovers novel strategies and consistently outperforms existing attack baselines. Our code is available at https://github.com/CjangCjengh/web_agent_attack.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。