arXiv:2503.20279cs.CLcs.AI2025-03ACL被引 8

提出新攻击框架SUDO,能绕过主流AI助手安全防护

sudo rm -rf agentic_security

  • 用毒化-解毒-再毒化三步法伪装恶意指令
  • 在真实任务中对Claude实现最高41.33%攻击成功率
  • 适合关注AI安全、对抗攻击的研究者阅读

大型语言模型正被广泛用作计算机使用代理,在真实桌面或网页环境中自主执行任务。这一发展虽拓展了人类的应用场景,但也带来了严重的安全风险。本文提出SUDO(基于屏幕的通用解毒到毒化攻击)框架,系统性地绕过商业计算机使用代理中经拒绝训练的安全防护机制,如Claude for Computer Use。核心机制Detox2Tox通过解毒将有害请求转化为看似无害的形式,利用先进视觉语言模型(VLMs)获取详细指令,再在执行前通过毒化重新引入恶意内容。与传统越狱不同,SUDO基于内置的拒绝反馈迭代优化攻击,对强策略过滤器愈发有效。在涵盖50个真实任务及多个前沿VLM的测试中,SUDO在无精炼情况下达成24.41%的攻击成功率,经迭代优化后提升至41.33%。该研究揭示了此类漏洞及其在真实计算环境中的易被利用性,凸显亟需具备上下文感知能力的鲁棒防护机制。警告:本文包含有害或冒犯性模型输出。

原文摘要 · Abstract (English)

Large Language Models (LLMs) are increasingly deployed as computer-use agents, autonomously performing tasks within real desktop or web environments. While this evolution greatly expands practical use cases for humans, it also creates serious security exposures. We present SUDO (Screen-based Universal Detox2Tox Offense), a novel attack framework that systematically bypasses refusal-trained safeguards in commercial computer-use agents, such as Claude for Computer Use. The core mechanism, Detox2Tox, transforms harmful requests (that agents initially reject) into seemingly benign requests via detoxification, secures detailed instructions from advanced vision language models (VLMs), and then reintroduces malicious content via toxification just before execution. Unlike conventional jailbreaks, SUDO iteratively refines its attacks based on a built-in refusal feedback, making it increasingly effective against robust policy filters. In extensive tests spanning 50 real-world tasks and multiple state-of-the-art VLMs, SUDO achieves a stark attack success rate of 24.41% (with no refinement), and up to 41.33% (by its iterative refinement) in Claude for Computer Use. By revealing these vulnerabilities and demonstrating the ease with which they can be exploited in real-world computing environments, this paper highlights an immediate need for robust, context-aware safeguards. WARNING: This paper includes harmful or offensive model outputs

AI安全越狱攻击LLM代理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。