arXiv:2607.22445cs.AIcs.CR2026-07

动态权限管控让企业AI Agent只拥有必要权限,减少安全风险。

Dynamic Capability Scoping for Enterprise AI Agents: A Synthetic Dataset and Three-Source Permission Architecture

  • 设计三层动态权限架构,按角色、任务上下文和策略禁止组合实现最小权限。
  • 构建600条合成任务数据集,标注15种工具权限,人工验证一致性达96.7%。
  • 支持权限滥用行为监测,适合研究大模型代理对齐与安全机制的团队使用。

企业AI代理通常在配置时被赋予静态权限集,包含所有可能用到的工具,导致持续过度授权,扩大攻击面。本文主张权限管控应遵循动态最小权限原则,作为预防性措施而非事后检测。不存在于代理上下文中的凭证,即使被滥用也无法被利用。提出三源架构:基于角色的权限上限、任务上下文分类器、由策略生成的组合禁止规则,形成多层主动防御,防范大模型代理对齐偏差与滥用。该架构支持强制执行与仅观察部署;后者记录与任务上下文不符的权限请求,生成可用于对齐研究的行为信号。为评估该架构,构建了一个600条企业任务提示的合成数据集,基于多部门政策生成,采用15种工具权限分类体系,直接映射可部署凭证或可执行护栏。通过两阶段流水线分离提示生成与权限标注,避免循环依赖,并经60条样本、688项决策的人工评审验证(预审Cohen's κ=0.917,后审κ=0.967)。在数据集与策略迭代过程中,权限越界事件从46次降至3次,降低93%,证明合成提示生成可推动政策优化。数据集、环境说明与生成管道已公开,以支持动态权限机制评估。

原文摘要 · Abstract (English)

Enterprise AI agents are typically granted static credential sets at configuration time, holding every tool the role might need for every task they perform. This persistent over-privilege expands the attack surface. We argue that capability scoping must follow a dynamic least-privilege principle and be treated as a prevention mechanism before a detection one. A credential that does not exist in an agent's context cannot be misused regardless of the agent's reasoning or evasion sophistication. We outline a three-source architecture instantiating this principle: role-based ceilings, a task-context classifier, and policy-derived combination prohibitions creating a layered proactive defense against LLM agent misalignment and misuse cases. The architecture supports both enforcing and observe-only deployment; the latter records agent permission requests inconsistent with task context, producing a behavioral signal usable in misalignment research. As a first step toward evaluating this architecture, we contribute a synthetic dataset of 600 enterprise task prompts grounded in a multi-department company policy, labeled with minimum required permissions across a 15-permission tool-based taxonomy that maps directly to deployable credentials or enforceable guardrails. The dataset is constructed via a two-pass pipeline that separates prompt generation from permission labeling to avoid circularity, and is validated against a 60-record/688 decisions human-reviewed sample (Cohen's $κ= 0.917$ pre-review and $κ= 0.967$ post-review). Iterating between dataset and policy reduced ceiling violations from 46 to 3, a 93% reduction. This shows that synthetic prompt generation can drive policy refinement when the two are developed together. The dataset, environment specification, and generation pipeline are released to support evaluation of dynamic scoping mechanisms.

AI安全权限管理大模型代理合成数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。