arXiv:2505.02846cs.CYcs.AI2025-05被引 1

AI治理需平衡谨慎与创新,中间可设'观察等待'策略

The Precautionary Principle and the Innovation Principle: Incompatible Guides for AI Innovation Governance?

  • 用信号检测理论建模,区分误拦创新与误放风险
  • 成本比适中时最优是'观察等待'而非非黑即白
  • 监管沙盒适合可控试验,但通用大模型不适用

在人工智能治理政策讨论中,谨慎原则(PP)和创新原则(IP)分别由不同利益集团倡导。本文认为,若限定为弱形式的PP与IP,二者并非必然冲突。其核心在于全面权衡类型I错误成本(误拦创新)与类型II错误成本(误放创新)。基于信号检测理论模型,当预期类型I/类型II成本比足够小(大)时,弱形式的红灯(绿灯)决策最优;在中间比例时,最优策略为黄灯‘观察等待’。监管沙盒允许在有限范围和时间内进行AI测试,使成本比落入观察等待区间。通过沙盒,监管者与企业可学习成本比,并调整监管、技术或商业模式以避免进入红灯区。然而,通用型基础模型因难以识别误判成本,不适合作为沙盒对象。

原文摘要 · Abstract (English)

In policy debates concerning the governance and regulation of Artificial Intelligence (AI), both the Precautionary Principle (PP) and the Innovation Principle (IP) are advocated by their respective interest groups. Do these principles offer wholly incompatible and contradictory guidance? Does one necessarily negate the other? I argue here that provided attention is restricted to weak-form PP and IP, the answer to both of these questions is "No." The essence of these weak formulations is the requirement to fully account for type-I error costs arising from erroneously preventing the innovation's diffusion through society (i.e. mistaken regulatory red-lighting) as well as the type-II error costs arising from erroneously allowing the innovation to diffuse through society (i.e. mistaken regulatory green-lighting). Within the Signal Detection Theory (SDT) model developed here, weak-PP red-light (weak-IP green-light) determinations are optimal for sufficiently small (large) ratios of expected type-I to type-II error costs. For intermediate expected cost ratios, an amber-light 'wait-and-monitor' policy is optimal. Regulatory sandbox instruments allow AI testing and experimentation to take place within a structured environment of limited duration and societal scale, whereby the expected cost ratio falls within the 'wait-and-monitor' range. Through sandboxing regulators and innovating firms learn more about the expected cost ratio, and what respective adaptations -- of regulation, of technical solution, of business model, or combination thereof, if any -- are needed to keep the ratio out of the weak-PP red-light zone. Nevertheless AI foundation models are ill-suited for regulatory sandboxing as their general-purpose nature precludes credible identification of misclassification costs.

AI治理监管沙盒信号检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。