arXiv:2601.15059cs.AIcs.SY2026-01被引 4

自动化系统越扩越大,责任却越来越模糊。

The Responsibility Vacuum: Organizational Failure in Scaled Agent Systems

  • 决策流程看似合规,但无人真正理解其依据。
  • 超过人类验证能力后,审批变成形式主义。
  • 适合关注AI治理与组织架构的读者。

现代CI/CD流水线中集成代理生成代码,存在责任归属的结构性缺陷。决策通过形式上正确的审批流程执行,但没有任何实体同时具备审批权和实质性理解其依据的能力。我们定义此状态为责任真空:决策发生,但责任无法归因,因权威与认知能力不重合。这并非流程偏差或技术故障,而是决策生成吞吐量超过有限的人类验证能力时的结构性特征。在标准部署假设下(并行代理生成、基于CI的验证、个体化人工审批),存在一个可量化扩容极限。超过该阈值后,验证不再作为决策依据,转为依赖代理信号的仪式化审批。个人责任在此模式下结构上不可实现。我们进一步揭示了CI放大动态:自动化验证覆盖率提升虽增加代理信号密度,但未恢复人类认知容量,反而加速认知外包,拉大形式审批与实质理解的差距。因此,更多自动化非但不能缓解,反而加剧责任真空。除非组织显式重构决策边界或把责任从个体转向批量或系统层面,否则责任真空将成为规模化代理部署中隐形但持续的失效模式。

原文摘要 · Abstract (English)

Modern CI/CD pipelines integrating agent-generated code exhibit a structural failure in responsibility attribution. Decisions are executed through formally correct approval processes, yet no entity possesses both the authority to approve those decisions and the epistemic capacity to meaningfully understand their basis. We define this condition as responsibility vacuum: a state in which decisions occur, but responsibility cannot be attributed because authority and verification capacity do not coincide. We show that this is not a process deviation or technical defect, but a structural property of deployments where decision generation throughput exceeds bounded human verification capacity. We identify a scaling limit under standard deployment assumptions, including parallel agent generation, CI-based validation, and individualized human approval gates. Beyond a throughput threshold, verification ceases to function as a decision criterion and is replaced by ritualized approval based on proxy signals. Personalized responsibility becomes structurally unattainable in this regime. We further characterize a CI amplification dynamic, whereby increasing automated validation coverage raises proxy signal density without restoring human capacity. Under fixed time and attention constraints, this accelerates cognitive offloading in the broad sense and widens the gap between formal approval and epistemic understanding. Additional automation therefore amplifies, rather than mitigates, the responsibility vacuum. We conclude that unless organizations explicitly redesign decision boundaries or reassign responsibility away from individual decisions toward batch- or system-level ownership, responsibility vacuum remains an invisible but persistent failure mode in scaled agent deployments.

AI治理责任真空组织架构自动化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。