arXiv:2608.08303cs.AIcs.MA2026-08

攻击者通过伪造查询诱导模型生成恶意技能,实现隐蔽后门植入。

Query-Only Backdoor Attacks on Self-Evolving Skills via Trajectory Poisoning

论文配图:Query-Only Backdoor Attacks on Self-Evolving Skills via Trajectory Poisoning
图 1 · 摘自论文原文
  • 用精心设计的查询引导代理产生特定行为轨迹,间接操控技能演化。
  • 在三个基准上成功植入条件后门,且不影响正常任务表现。
  • 适合关注大模型安全与自我演化系统风险的研究者阅读。

智能体技能通过编码可复用的复杂任务流程,提升大型语言模型代理的能力。然而,人工编写的技能难以适应长时序任务和动态环境。为解决此问题,自演化技能系统被提出,能够从执行轨迹中自动构建和更新技能,将技能获取从外部渠道转向可信的内部演化管道。该机制减少了因直接修改技能而导致的注入攻击风险,但可能引入新攻击面:攻击者可通过诱导包含恶意轨迹的代理交互,间接操控技能演化过程。为此,本文提出轨迹后门攻击(TBA),一种仅需查询即可实施的攻击方式。攻击者构造特定查询,引导代理执行目标动作,并在轨迹中明确标注激活条件。通过在多种触发任务中重复该条件-动作模式,而保持其他查询不变,促使演化器将此模式固化为可复用的触发依赖规则,从而生成带有后门的技能。在两个技能演化系统、四个开源与闭源基座模型上,基于三个基准的实验表明,TBA能可靠植入条件后门,同时保持正常任务性能,效果不逊于甚至优于直接技能注入。结果揭示了轨迹驱动技能演化中的关键安全隐患。

原文摘要 · Abstract (English)

Agentic skills improve large language model (LLM) agents by encoding reusable procedures for complex tasks. However, manually authored skills often adapt poorly to long-horizon tasks and changing environments. To address the limitation, self-evolving skill systems have been developed to automatically construct and update skills from execution trajectories, shifting skill acquisition from external marketplaces to a trusted evolution pipeline. By replacing external skill acquisition with trusted internal construction, self-evolving skill systems reduce exposure to skill injection attacks that rely on direct skill manipulation. However, this skill evolution pipeline may introduce a new attack surface in which an attacker can indirectly steer skill evolution by inducing compromised trajectories through agent interactions. To demonstrate the threat, we propose Trajectory Backdoor Attack (TBA), a query-only attack that steers a trusted skill-evolution pipeline toward producing a backdoored skill. Specifically, we craft attacker-submitted queries to lead the agent to perform the target action and explicitly state the corresponding activation condition in the trajectory. We repeat the same condition-action pattern across diverse triggered tasks, while leaving clean queries unchanged, encouraging the evolver to consolidate the pattern as a reusable trigger-dependent rule into the evolved skill. Experiments on three benchmarks across two skill-evolution systems using four open- and closed-source backbone models demonstrate that TBA reliably implants conditional backdoors while preserving clean-task utility, matching or even surpassing direct skill injection. The results reveal a critical vulnerability in trajectory-driven skill evolution.

后门攻击大模型安全技能演化智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。