arXiv:2605.00424cs.CRcs.AI2026-05被引 3

为人工介入的智能体技能设计可验证的信任机制,确保运行时安全可控。

Skills as Verifiable Artifacts: A Trust Schema and a Biconditional Correctness Criterion for Human-in-the-Loop Agent Runtimes

  • 将技能视为未经验证的代码,运行时必须强制验证而非依赖签名或来源
  • 提出双向正确性准则,确保验证过程在对抗性测试中可靠有效
  • 适合构建可信智能体系统的开发者和安全架构师参考

智能体技能——即不修改大语言模型本身、仅通过结构化指令与脚本增强模型能力的封装包——已从便利工具演变为首要部署对象。然而,其运行时继承了包管理器与操作系统长期面临的核心问题:内容声称具备某种行为,但运行时需判断是否可信。本文主张:技能默认为不可信代码,运行时必须强制执行验证,而非通过签名、许可或来源注册推断信任。若无技能验证,人工介入(HITL)须在每次不可逆调用时触发,这在实际操作中不可持续,且在复杂场景下退化为形式主义审批。将验证作为独立受控流程后,仅对未验证技能触发HITL,系统才可持续。本文提出信任架构:每个技能清单显式标注验证等级;基于该等级配置能力门控;定义对抗性集成测试下的双向正确性标准;并提炼出十项可移植运行时规范,源自一个开源参考实现。该方案与框架和模型无关,无需微调、重训练或专有基础设施。

原文摘要 · Abstract (English)

Agent skills - structured packages of instructions, scripts, and references that augment a large language model (LLM) without modifying the model itself - have moved from convenience to first-class deployment artifact. The runtime that loads them inherits the same problem package managers and operating systems have always faced: a piece of content claims a behavior; the runtime must decide whether to believe it. We argue this paper's central thesis up front: a skill is untrusted code until it is verified, and the runtime that loads it must enforce that default rather than infer trust from a signature, a clearance, or a registry of origin. Without skill verification, a human-in-the-loop (HITL) gate must fire on every irreversible call - which is operationally untenable and degrades into rubber-stamping at any non-trivial scale. With skill verification treated as a separate, gated process, HITL fires only for what is unverified, and the system becomes sustainable. We give a trust schema that includes an explicit verification level on every skill manifest; a capability gate whose HITL policy is a function of that verification level; a biconditional correctness criterion that any candidate verification procedure must satisfy on an adversarial-ensemble exercise; and a portable runtime profile with ten normative guidelines abstracted from a working open-source reference implementation. The contribution is harness- and model-agnostic; nothing here requires retraining, fine-tuning, or proprietary infrastructure.

智能体信任机制安全验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。