arXiv:2606.17286cs.CYcs.AI2026-06

AI系统如何在民主与专制国家中被设计成压制工具

From Democracies to Autocracies: How AI Systems Enable Authoritarianism by Design

  • 分析六项AI系统生命周期,揭示其共性设计缺陷
  • 数据集中化与群体特征编码加剧对弱势群体的监控
  • 无论集中或分散系统,治理漏洞都可能助长专制

本文通过分析从美国到中国等不同政治体制下部署的六项AI系统,揭示了人工智能如何在各类政权中被用于强化专制。研究基于学术论文、调查报告、第三方评估、媒体访谈及政府采购文件等多元资料,进行系统性定性比较,识别出关键技术与操作特征:行政数据的集中与收编用于执法与政治惩罚、监管空白导致滥用、用户合规性弱化人类监督机制、以及对受保护群体特征的编码识别。这些特征在专制与民主国家中均存在,但配置方式不同。无论是由行政部门主导的集中式系统,还是多方分立的碎片化系统,均因治理缺位而助长专制——前者缺乏正式监督,后者责任分散。研究指出,AI专制是设计与操作选择共同导致的分布式现象。最后提出开发者与政策制定者的风险缓解建议。

原文摘要 · Abstract (English)

AI-enabled authoritarianism is not confined to autocracies. In this paper, we provide greater transparency by investigating and mapping the lifecycles of six AI systems deployed in different political regimes, ranging from the US to China. By drawing on an extensive range of sources (academic publications, investigative research reports, third-party evaluations, media interviews, government procurement notices), we conduct a systematic, qualitative comparison across systems to identify the critical technical and operational features that enable authoritarianism within their respective political contexts. We find that enabling features include the centralization and co-optation of administrative data for law enforcement and political punishment, regulatory gaps that fail to deter misuse, weak user compliance that nullifies human oversight mechanisms, and the encoding of protected group traits that identify members of vulnerable populations. We find that these features are present across systems deployed in autocratic and democratic regimes, albeit in varying configurations. We also find that both centralized and fragmented AI systems can contribute to authoritarianism by exploiting governance gaps: centralized systems directed by executive authorities, particularly within security and military institutions, are often not subjected to formal oversight mechanisms, while fragmented systems diffuse accountability between stakeholders, paving the way for entrenchment. These findings reveal that AI-enabled authoritarianism is distributed, resulting from design and operational choices made by developers, administrators, and users alike. We conclude with recommendations for developers and policymakers to mitigate these risks.

AI伦理数据监控专制技术治理漏洞

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。