为自治多智能体系统事故责任划分提供可验证的审计与因果归因方案。
AUDITA: certified auditing and causal attribution of adverse outcomes in autonomous multi-agent systems
- 通过不可篡改的指令记录与认证的分级因果分析引擎实现责任审计。
- 在真实语言模型流水线中将责任误判率降低约三分之二,事故案例中恢复了被遗漏的责任归属。
- 适合用于工厂、仓库等自动化系统中的责任追踪,尤其在多方协作场景下避免推诿。
物理自动化正迈向由人工智能驱动的实体机器舰队。早期部署已实现超越人力的生产效率,且应用加速扩展。但当其联合决策导致损害时,各方均可能互相推责——包括机器供应商、算法提供方、工厂运营者、保险公司与监管机构,而现有方法无法准确划分责任。现有技术依赖无法验证的日志,仅指定单一责任人,错误地处理了多重决定、提前终止或遗漏导致的结果。我们提出AUDITA,一种审计层架构,结合不可篡改的跨智能体指令记录与认证的分级因果归因引擎。证明其裁决无法被操纵:合规代理绝不会被错误定责,试图转移责任的行为会被识别并量化评分,并确立基于证据的审计上限。在真实语言模型流水线上,责任误判率相较标准裁判基线降低约三倍;在基于事故结构的基准测试中,恢复了单责任人基线遗漏的责任归属,且对伪造行为保持不变。AUDITA将‘谁该负责’从日志争议转变为基于证据的计算问题。
原文摘要 · Abstract (English)
Physical automation is scaling toward fleets of embodied machines commanded by an AI brain. Early deployments already run factories and warehouses at production rates beyond any human line, and their adoption is accelerating. But when their joint decisions cause harm, everyone involved has reason to blame everyone else, the machine vendor, the algorithm provider, the factory operator, the insurer, and the regulator, and no method can divide the responsibility between them. Existing methods read logs whose origin they cannot verify and name a single culprit, misrepresenting outcomes that are overdetermined, preempted, or caused by an omission. We present AUDITA, an audit layer pairing a tamper-evident record of every inter-agent command with a certified, graded causal-attribution engine. We prove its verdict cannot be gamed: a rule-following agent can never be made to look guilty, an attempt to shift blame is itself caught and graded, and we establish the exact limit of what an evidence-based auditor can certify. On live language-model pipelines it reduces the standard judge baseline's responsibility error roughly threefold; on a benchmark of accident-grounded structures it recovers responsibility where single-culprit baselines fail, and stays invariant under forgery. AUDITA turns the question of who is to blame from an argument about logs into a calculation over evidence.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。