让大模型自己判断权限,防止越权操作
Chain-of-Authorization: Embedding authorization into large language models
- 在推理过程中内置权限验证链条,强制模型先通过授权才可响应
- 对越权请求拒绝率高,且能抵御多种攻击手段
- 适合需要严格安全控制的AI系统部署场景
尽管大语言模型已从文本生成器演变为现代AI系统的核心认知组件,其内在缺乏权限意识仍导致系统面临灾难性风险,包括意外数据泄露和未经授权的指令执行。现有防御机制与内部推理过程脱节,难以满足动态AI系统的复杂安全需求。本文提出链式授权(Chain-of-Authorization, CoA)框架,将访问控制作为基础认知能力内化。通过重构输入输出格式,并在包含复杂权限拓扑的合成数据上微调模型,CoA强制模型在生成实质性响应或执行动作前,必须生成结构化的授权轨迹,从而在动态推理环境中内化访问边界。该方法在授权场景保持高可用性的同时,对未授权请求实现高拒绝率,并对多种对抗攻击具有强鲁棒性。通过将权限嵌入推理流程,CoA为部署安全的大语言模型作为现代AI系统认知核心提供了原则性架构蓝图。
原文摘要 · Abstract (English)
Although Large Language Models (LLMs) have evolved from text generators into the cognitive core of modern AI systems, their inherent lack of authorization awareness exposes these systems to catastrophic risks, ranging from unintentional data leakage to unauthorized command execution. Existing defense mechanisms are fundamentally decoupled from internal reasoning, rendering them insufficient for the complex security demands of dynamic AI systems. Here, we propose the Chain-of-Authorization (CoA) framework, a paradigm that internalizes access control as a foundational cognitive capability. By systematically redesigning the input-output format and fine-tuning the model on synthesized data with complex permission topologies, CoA forces the model to generate a structured authorization trajectory as a causal prerequisite for any substantive response or action, thereby enabling LLMs to internalize access boundaries within dynamic reasoning environments. CoA maintains high utility in authorized scenarios while achieving high rejection rates of unauthorized prompts and robust defense against diverse adversarial attacks. By embedding authorization directly into the reasoning process, CoA provides a principled architectural blueprint for deploying secure LLMs as the cognitive cores of modern AI systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。