arXiv:2608.26733cs.CRcs.AI2026-08

黑盒攻击通过正常任务交互,偷取隐藏的智能体技能。

Daydreaming: Stealing Hidden Agent Skills through Black-Box Task Interaction

论文配图:Daydreaming: Stealing Hidden Agent Skills through Black-Box Task Interaction
图 1 · 摘自论文原文
  • 用精心设计的任务逐步探测隐含行为,不直接请求技能文件。
  • 在4个模型上恢复86.8%原始技能功能,仅需32次调用。
  • 适合研究模型安全与对抗性技能泄露的从业者。

智能体技能包含指令、参考数据和可执行辅助文件,使通用智能体完成特定任务。托管方可在不公开文件的情况下出售任务结果服务,使技能本身成为高价值目标。现有披露防御可阻止对技能的直接请求或文本复现,但无法阻止客户提交服务本应完成的常规任务。本文提出Daydreaming,一种仅依赖执行结果的黑盒攻击,可从多文件技能中窃取完整功能。攻击者无需请求技能或评估重建结果,而是自适应生成能区分潜在行为的任务,利用可控的影子智能体选择设计方案,并结合存储的受害者响应和本地执行验证完成每份文件重建。我们形式化了三级访问威胁:差分、追踪与输出,聚焦于输出级别——攻击者仅能看到最终响应和返回文件。在7个技能与4个受害者模型上,Daydreaming在输出级别恢复了86.8%的原始能力,性能比SigLeak高出近4倍。即使启用披露防御,平均仅需32次受害者调用即可生成可安装技能。结果表明,仅隐藏文件并过滤直接披露,不足以防止通过正常使用实现功能重构。

原文摘要 · Abstract (English)

Agent skills bundle instructions, reference data, and executable helpers that let a general agent perform specialized tasks. Hosted providers can keep these files secret while selling access to task results, making the skill itself a valuable target. Existing disclosure defenses can block requests that ask for the skill or reproduce its text, but they cannot block customers from submitting the ordinary tasks the service is built to complete. We present Daydreaming, an execution-only attack that steals a multi-file skill through black-box task interactions. The victim is never asked to reveal the skill or grade a reconstruction. Instead, Daydreaming adaptively creates crafted tasks whose results distinguish possible hidden behaviors. It tests individual behaviors, uses attacker-controlled shadow agents to choose a design, and completes each file using stored victim results and local execution checks. We formalize three nested threat levels of access as Differential, Trace, and Output, and focus on Output, where the attacker sees only the final response and returned files. Across 7 skills and 4 victim models, Daydreaming recovers 86.8% of the original skill's capability at Output, outperforming SigLeak by almost 4x. It produces installable skills using a median of 32 victim calls per skill even with disclosure defenses enabled. These results show that hiding skill files and filtering direct disclosure do not, by themselves, prevent functional reconstruction through normal use.

模型安全黑盒攻击技能窃取

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。