arXiv:2602.19629cs.HCcs.AI2026-02

AI协作幻觉背后是责任失衡,需制度设计保障长期可信合作

Cooperation After the Algorithm: Designing Human-AI Coexistence Beyond the Illusion of Collaboration

  • 提出合作生态框架,用六项原则规范人机协作制度
  • 揭示依赖AI是否理性取决于治理条件与问责机制
  • 给出合作宪章、风险登记册等可落地的政策工具

生成式AI在科研、法律、教育、媒体和治理等领域日益参与,其流畅适应的输出制造出协作假象。然而这些系统不承担后果责任或连带义务,导致高风险领域已出现处罚、专业失误与治理失败。本文认为稳定的人机共存是制度成果,依赖能分配剩余风险的治理基础设施。基于制度分析与进化合作理论,提出一个形式化不平等公式,明确在何种治理条件下依赖AI能产生正向预期合作价值。模型揭示治理环境、系统策略与问责机制共同决定合作是否合理或结构性缺陷。由此推导出包含互惠契约、可见信任架构、条件性合作模式、违约缓解机制、对抗权威表演的叙事素养及地球优先可持续约束的六项设计原则。通过三类政策工具实现:人机协作宪章、违约风险登记册、合作准备度审计。整体将分析单位从用户-AI二元关系转向塑造激励、信号、问责与修复的制度环境。论文提供理论基础与实践工具,以实现长期可问责、可信赖的人机合作。

原文摘要 · Abstract (English)

Generative artificial intelligence systems increasingly participate in research, law, education, media, and governance. Their fluent and adaptive outputs create an experience of collaboration. However, these systems do not bear responsibility, incur liability, or share stakes in downstream consequences. This structural asymmetry has already produced sanctions, professional errors, and governance failures in high-stakes contexts We argue that stable human-AI coexistence is an institutional achievement that depends on governance infrastructure capable of distributing residual risk. Drawing on institutional analysis and evolutionary cooperation theory, we introduce a formal inequality that specifies when reliance on AI yields positive expected cooperative value. The model makes explicit how governance conditions, system policy, and accountability regimes jointly determine whether cooperation is rational or structurally defective. From this formalization we derive a cooperation ecology framework with six design principles: reciprocity contracts, visible trust infrastructure, conditional cooperation modes, defection-mitigation mechanisms, narrative literacy against authority theatre, and an Earth-first sustainability constraint. We operationalize the framework through three policy artefacts: a Human-AI Cooperation Charter, a Defection Risk Register, and a Cooperation Readiness Audit. Together, these elements shift the unit of analysis from the user-AI dyad to the institutional environment that shapes incentives, signals, accountability, and repair. The paper provides a theoretical foundation and practical toolkit for designing human-AI systems that can sustain accountable, trustworthy cooperation over time.

人机协作治理设计责任分配制度创新

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。