arXiv:2511.16709cs.CRcs.AI2025-11被引 7

用AI代理自动生成隐蔽后门,轻松攻破大模型。

AutoBackdoor: Automating Backdoor Attacks via LLM Agents

  • 让大模型当代理,自动生成语义自然的触发词
  • 仅用少量污染数据就让攻击成功率超90%
  • 适合研究安全防御或红队测试的人看

后门攻击对大型语言模型的安全部署构成严重威胁,可使攻击者通过特定输入激活隐藏行为。现有方法多依赖人工设计触发词和固定数据流程,缺乏灵活性且难以系统评估现代防御机制的鲁棒性。随着智能体能力提升,亟需更严谨、多样、可扩展的红队测试框架来真实模拟后门威胁并评估模型在对抗条件下的韧性。本文提出 extsc{AutoBackdoor},一个自动化后门注入通用框架,通过自主智能体驱动的流水线实现触发词生成、污染数据构建与模型微调。相比以往方法,该框架利用强大语言模型代理生成语义连贯、上下文感知的触发短语,实现跨任意主题的大规模污染,几乎无需人工干预。我们在三种现实威胁场景下评估:偏见推荐、幻觉注入与同行评审操控,涵盖 LLaMA-3、Mistral、Qwen 及 GPT-4o 等开源与商用模型。实验表明,本方法仅用少量污染样本即可实现超过90%的攻击成功率。更重要的是,现有多数防御手段无法有效缓解此类攻击,凸显了针对智能体驱动威胁进行更严格、动态评估的必要性。代码、数据集及实验配置将公开于 https://github.com/bboylyg/BackdoorLLM。

原文摘要 · Abstract (English)

Backdoor attacks pose a serious threat to the secure deployment of large language models (LLMs), enabling adversaries to implant hidden behaviors triggered by specific inputs. However, existing methods often rely on manually crafted triggers and static data pipelines, which are rigid, labor-intensive, and inadequate for systematically evaluating modern defense robustness. As AI agents become increasingly capable, there is a growing need for more rigorous, diverse, and scalable \textit{red-teaming frameworks} that can realistically simulate backdoor threats and assess model resilience under adversarial conditions. In this work, we introduce \textsc{AutoBackdoor}, a general framework for automating backdoor injection, encompassing trigger generation, poisoned data construction, and model fine-tuning via an autonomous agent-driven pipeline. Unlike prior approaches, AutoBackdoor uses a powerful language model agent to generate semantically coherent, context-aware trigger phrases, enabling scalable poisoning across arbitrary topics with minimal human effort. We evaluate AutoBackdoor under three realistic threat scenarios, including \textit{Bias Recommendation}, \textit{Hallucination Injection}, and \textit{Peer Review Manipulation}, to simulate a broad range of attacks. Experiments on both open-source and commercial models, including LLaMA-3, Mistral, Qwen, and GPT-4o, demonstrate that our method achieves over 90\% attack success with only a small number of poisoned samples. More importantly, we find that existing defenses often fail to mitigate these attacks, underscoring the need for more rigorous and adaptive evaluation techniques against agent-driven threats as explored in this work. All code, datasets, and experimental configurations will be merged into our primary repository at https://github.com/bboylyg/BackdoorLLM.

后门攻击AI代理模型安全红队测试

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。