arXiv:2608.17588cs.AIcs.SE2026-08

TRUSS自动生成安全可靠的智能体技能,通过执行证据验证功能与安全性。

TRUSS: Towards Task-Reliable and User-Safe Automated Agent Skill Generation

论文配图:TRUSS: Towards Task-Reliable and User-Safe Automated Agent Skill Generation
图 1 · 摘自论文原文
  • 基于源码和执行痕迹双重证据评估技能可靠性
  • 漏洞检测准确率100%,修复后攻击成功率减半
  • 适合需高安全性的自动化任务系统开发

Agent Skills 将可复用的自然语言指令与可执行资源封装,使软件代理在无需模型微调的情况下获得特定任务能力。自动生成技能可提升任务表现,但仅凭结果或产物评估难以判断代理实际行为及副作用。本文提出 TRUSS——一种基于证据的框架,用于生成功能有效且安全可靠的智能体技能。TRUSS 首先通过九项预定义安全属性检查技能完整产物,并结合源码与领域证据验证其功能声明;通过可信执行环境中的影子代理加载候选技能,由中介工具暴露操作并记录带溯源的执行轨迹,将功能失败与安全违规回溯至具体技能内容,驱动迭代优化。在 168 个 SkillInject 产物、155 个 SkillSafetyBench 案例和全部 187 个 SkillGenBench 任务上评估,TRUSS 实现漏洞检测 100.00% 精确率与召回率。修复后,GPT 5.5 下攻击成功率从 38.71% 降至 19.35%,GPT 5.4 从 46.45% 降至 29.68%,无攻击回归。技能生成方面,任务有效性从无技能时的 17.11% 提升至 52.94%,基准安全率从 50.80% 提升至 100.00%。结果表明,执行证据可揭示产物检查遗漏的行为缺陷,并引导技能生成实现功能与安全的联合验证。

原文摘要 · Abstract (English)

Agent Skills package reusable natural language procedures with executable resources, enabling software agents to acquire task specific capabilities without model adaptation. Automatically generating such Skills can improve task performance, yet evaluating a candidate solely from its artifact or final task outcome leaves unresolved which actions the equipped agent will perform and which side effects those actions will produce. We present TRUSS, an evidence guided framework for generating functionally effective and safety reliable Agent Skills. TRUSS first inspects functional claims against source and domain evidence while evaluating the complete artifact under nine predefined safety properties. Candidates admitted by this static gate are loaded by a shadow agent inside a Controllable Execution Environment, where brokered tools expose requested actions to policy enforcement and record their results as provenance preserving execution traces. Functional failures and property violations are linked back to the responsible Skill content and used to guide iterative refinement. We evaluate TRUSS on 168 SkillInject artifacts, 155 SkillSafetyBench cases, and all 187 tasks in SkillGenBench. TRUSS achieves 100.00\% precision and recall in vulnerability detection. Repair reduces attack success from 38.71\% to 19.35\% with GPT 5.5 and from 46.45\% to 29.68\% with GPT 5.4, with zero attack regression. For Skill generation, TRUSS raises task effectiveness from 17.11\% without Skills to 52.94\%, while increasing the benchmark Security rate from 50.80\% to 100.00\%. These results show that execution evidence can expose behavioral failures missed by artifact inspection and can guide Skill generation toward jointly verified functional and safety outcomes.

智能体技能安全生成执行验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。