arXiv:2604.27292cs.AI2026-04被引 6

AI治理失效源于能力边界与监管边界不一致,需从架构上统一二者。

The Two Boundaries: Why Behavioral AI Governance Fails Structurally

  • 通过分离计算与执行,使治理边界与能力边界完全重合
  • 证明在通用架构下治理行为不可判定,必须依赖架构设计
  • 提出可验证的治理标准:边界一致则无风险,否则必然存在隐患

所有产生实际影响的系统都有两个边界:其能实现的能力(表达性)和治理覆盖的范围(治理)。当前多数部署的AI系统独立定义这两个边界,形成三个区域:受控能力(唯一有效区)、不受控能力(风险区)以及针对不存在能力的治理表演(剧场区)。本文聚焦于对系统行为的治理——即在世界中执行的动作(如API调用、数据库写入、工具调用),区别于对模型输出(内容质量、偏见等)的治理。我们提出一个形式化框架分析这一结构性缺口。根据1953年Rice定理,在任何图灵完备架构下,试图行为式治理效果时,该缺口是不可判定的:无法判断任意程序的效果是否符合治理策略。我们定义‘共界治理’(coterminous governance):表达性边界与治理边界完全一致。证明这种治理需在架构层面做出决策(将计算与执行分离),而非事后添加治理层。结构化治理在此分离下可涵盖原有治理基础设施:治理检查成为执行流水线的一部分,而非并行运行的独立系统。我们提出共界治理作为可测试的治理标准:要么两边界可被严格证明相等,否则风险与剧场现象必然存在。所有证明均在Coq中机械化(454个定理,36个模块,0个公设)。

原文摘要 · Abstract (English)

Every system that performs effects has two boundaries: what it can do (expressiveness) and what governance covers (governance). In nearly all deployed AI systems, these boundaries are defined independently, creating three regions: governed capabilities (the only useful region), ungoverned capabilities (risk), and governance policies that address non-existent capabilities (theater). Two of the three regions are failure modes. We focus on the governance of effects: actions that AI systems perform in the world (API calls, database writes, tool invocations). This is distinct from the governance of model outputs (content quality, bias, fairness), which operates at a different level and requires different mechanisms. We present a formal framework for analyzing this structural gap. Rice's theorem (1953) proves the gap is undecidable in the general case for any Turing-complete architecture that attempts to govern effects behaviorally: no algorithm can decide non-trivial semantic properties of arbitrary programs, including the property "this program's effects comply with the governance policy." We define coterminous governance: a system property where the expressivenessboundary equals the governance boundary. We show that coterminous governance requires an architectural decision (separatingcomputation from effect) rather than a governance layer added after the fact. We show that structural governance under this separation subsumes separate governance infrastructure: governance checks become part of the execution pipeline rather than a second system running alongside it. We propose coterminous governance as the testable criterion for any AI governance system: either the two boundaries are provably identical, or risk and theater are structurally inevitable. Proofs are mechanized in Coq (454 theorems, 36 modules, 0 admitted).

AI治理架构设计形式化验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。