arXiv:2604.05485cs.AI2026-04被引 13

让AI代理可追责,关键在系统必须能审计。

Auditable Agents

论文配图:Auditable Agents
图 1 · 摘自论文原文
  • 提出五维审计能力框架,确保行为可追溯
  • 实测预执行记录仅增8.3毫秒延迟,可行性强
  • 适合关注AI安全与合规的研究者和开发者

大型语言模型代理会调用工具、查询数据库、委派任务并引发外部影响。一旦代理系统具备现实行动能力,问题就不仅是防止有害行为,更在于这些行为是否能在部署后被追责。本文区分了问责(确定合规性并归责)、审计性(使问责成为可能的系统属性)和审计(从可信证据重建行为的过程)。核心主张:无审计性则无法实现问责。为此,定义了五个审计维度:动作可恢复性、生命周期覆盖性、策略可检查性、责任归属性和证据完整性,并识别三类机制(检测、强制、恢复),其时间约束说明单一方法难以奏效。通过多层次证据支持:生态底层测量发现六项开源项目存在617个安全缺陷,表明基础审计条件普遍缺失;运行时可行性结果表明,使用防篡改记录的预执行干预仅增加8.3毫秒中位延迟;受控恢复实验显示,即使常规日志丢失,仍可部分恢复责任相关数据。提出代理系统的审计卡,并识别六个按机制分类的开放研究问题。

原文摘要 · Abstract (English)

LLM agents call tools, query databases, delegate tasks, and trigger external side effects. Once an agent system can act in the world, the question is no longer only whether harmful actions can be prevented--it is whether those actions remain answerable after deployment. We distinguish accountability (the ability to determine compliance and assign responsibility), auditability (the system property that makes accountability possible), and auditing (the process of reconstructing behavior from trustworthy evidence). Our claim is direct: no agent system can be accountable without auditability. To make this operational, we define five dimensions of agent auditability, i.e., action recoverability, lifecycle coverage, policy checkability, responsibility attribution, and evidence integrity, and identify three mechanism classes (detect, enforce, recover) whose temporal information-and-intervention constraints explain why, in practice, no single approach suffices. We support the position with layered evidence rather than a single benchmark: lower-bound ecosystem measurements suggest that even basic security prerequisites for auditability are widely unmet (617 security findings across six prominent open-source projects); runtime feasibility results show that pre-execution mediation with tamper-evident records adds only 8.3 ms median overhead; and controlled recovery experiments show that responsibility-relevant information can be partially recovered even when conventional logs are missing. We propose an Auditability Card for agent systems and identify six open research problems organized by mechanism class.

AI安全可审计性代理系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。