arXiv:2604.10286cs.AI2026-04被引 1

提出动态风险评分系统,实时判断智能体调用技能是否安全。

STARS: Skill-Triggered Audit for Request-Conditioned Invocation Safety in Agent Systems

论文配图:STARS: Skill-Triggered Audit for Request-Conditioned Invocation Safety in Agent Systems
图 1 · 摘自论文原文
  • 结合静态能力先验与请求条件风险模型,实现调用时风险评分。
  • 在间接提示注入攻击测试中,风险评分AUPRC达0.439,优于基线。
  • 适合需要实时安全防护的自主智能体系统开发者使用。

自主语言模型智能体越来越多依赖可安装技能和工具完成用户任务。静态技能审计可在部署前暴露能力面,但无法判断特定调用在当前用户请求和运行时上下文下是否危险。因此,我们将技能调用审计视为连续风险估计问题:给定用户请求、候选技能和运行时上下文,预测一个得分以支持调用前的风险排序与优先级处理。我们提出STARS,融合静态能力先验、请求条件调用风险模型与校准的风险融合策略。为评估该设置,我们构建SIA-Bench,包含3,000条调用记录,具有分组安全划分、溯源元数据、运行时上下文、标准动作标签及衍生的连续风险目标。在保留的间接提示注入攻击测试集上,校准融合达到0.439高风险AUPRC,优于0.405的上下文评分器和0.380的最强静态基线,且上下文评分器校准性更优(0.289期望校准误差)。在锁定的分布内测试集上,提升较小,静态先验仍具价值。结论更明确:请求条件审计最适合作为调用时的风险评分与优先级处理层,而非替代静态筛查。代码已开源。

原文摘要 · Abstract (English)

Autonomous language-model agents increasingly rely on installable skills and tools to complete user tasks. Static skill auditing can expose capability surface before deployment, but it cannot determine whether a particular invocation is unsafe under the current user request and runtime context. We therefore study skill invocation auditing as a continuous-risk estimation problem: given a user request, candidate skill, and runtime context, predict a score that supports ranking and triage before a hard intervention is applied. We introduce STARS, which combines a static capability prior, a request-conditioned invocation risk model, and a calibrated risk-fusion policy. To evaluate this setting, we construct SIA-Bench, a benchmark of 3,000 invocation records with group-safe splits, lineage metadata, runtime context, canonical action labels, and derived continuous-risk targets. On a held-out split of indirect prompt injection attacks, calibrated fusion reaches 0.439 high-risk AUPRC, improving over 0.405 for the contextual scorer and 0.380 for the strongest static baseline, while the contextual scorer remains better calibrated with 0.289 expected calibration error. On the locked in-distribution test split, gains are smaller and static priors remain useful. The resulting claim is therefore narrower: request-conditioned auditing is most valuable as an invocation-time risk-scoring and triage layer rather than as a replacement for static screening. Code is available at https://github.com/123zgj123/STARS.

智能体安全风险评估提示注入

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。