arXiv:2505.21570cs.CYcs.AI2025-05被引 5

用验证替代解释性,更可靠地监管高风险AI系统。

Beyond Explainability: The Case for AI Validation

  • 以输出可靠性为核心,构建四类AI系统分类框架
  • 验证能提升高风险场景下的公平性与安全性
  • 适合关注AI治理与合规的政策制定者

人工智能知识(AK)系统正深刻改变医疗、金融、司法等关键领域的决策方式。然而其日益增强的不透明性带来了治理挑战,当前以可解释性为主的监管手段难以有效应对。本文主张将验证作为核心监管支柱:通过确保输出的可靠性、一致性和鲁棒性,提供比可解释性更具实践性、可扩展性与风险敏感性的替代方案,尤其适用于技术或经济上无法实现可解释性的高风险场景。我们提出基于有效性与可解释性双维度的四类系统分类法,揭示二者间的权衡关系。结合欧盟、美国、英国、中国监管实践的比较分析,表明即使在可解释性受限的情况下,验证仍可增强社会信任、公平性与安全性。本文提出涵盖部署前后验证、第三方审计、统一标准与责任激励的前瞻性政策框架,平衡创新与问责,为透明度低但性能高的智能系统负责任地融入社会提供治理路径。

原文摘要 · Abstract (English)

Artificial Knowledge (AK) systems are transforming decision-making across critical domains such as healthcare, finance, and criminal justice. However, their growing opacity presents governance challenges that current regulatory approaches, focused predominantly on explainability, fail to address adequately. This article argues for a shift toward validation as a central regulatory pillar. Validation, ensuring the reliability, consistency, and robustness of AI outputs, offers a more practical, scalable, and risk-sensitive alternative to explainability, particularly in high-stakes contexts where interpretability may be technically or economically unfeasible. We introduce a typology based on two axes, validity and explainability, classifying AK systems into four categories and exposing the trade-offs between interpretability and output reliability. Drawing on comparative analysis of regulatory approaches in the EU, US, UK, and China, we show how validation can enhance societal trust, fairness, and safety even where explainability is limited. We propose a forward-looking policy framework centered on pre- and post-deployment validation, third-party auditing, harmonized standards, and liability incentives. This framework balances innovation with accountability and provides a governance roadmap for responsibly integrating opaque, high-performing AK systems into society.

AI治理验证机制风险监管

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。