arXiv:2511.01902cs.CYcs.AI2025-11被引 1

为医疗AI临床落地前提供可操作的设计指南

Before the Clinic: Transparent and Operable Design Principles for Healthcare AI

  • 提出透明设计与可操作设计两大原则,指导AI系统预临床开发
  • 强调可解释性、不确定性建模与鲁棒性,确保真实场景下可靠运行
  • 适合研发团队、医生及监管方协同推进AI医疗应用

将人工智能(AI)系统转化为临床实践,需弥合可解释AI理论、临床医生期望与治理要求之间的根本差距。尽管概念框架定义了可解释AI(XAI)的内涵,定性研究揭示了医生需求,但开发团队在临床评估前仍缺乏具体指导。本文提出两大基础设计原则:透明设计涵盖可解释性与可理解性工具,支持个案推理与系统可追溯性;可操作设计涵盖校准、不确定性量化与鲁棒性,确保系统在真实环境中稳定可靠。这些原则基于现有XAI框架,映射临床需求,并与新兴治理要求对齐。该预临床指南为开发团队提供可执行方案,加速临床评估进程,建立研究者、医疗从业者与监管方间的共享语言。通过明确定义部署前可构建与验证的内容,旨在降低临床AI转化阻力,同时谨慎界定已验证的可解释性范畴。

原文摘要 · Abstract (English)

The translation of artificial intelligence (AI) systems into clinical practice requires bridging fundamental gaps between explainable AI theory, clinician expectations, and governance requirements. While conceptual frameworks define what constitutes explainable AI (XAI) and qualitative studies identify clinician needs, little practical guidance exists for development teams to prepare AI systems prior to clinical evaluation. We propose two foundational design principles, Transparent Design and Operable Design, that operationalize pre-clinical technical requirements for healthcare AI. Transparent Design encompasses interpretability and understandability artifacts that enable case-level reasoning and system traceability. Operable Design encompasses calibration, uncertainty, and robustness to ensure reliable, predictable system behavior under real-world conditions. We ground these principles in established XAI frameworks, map them to documented clinician needs, and demonstrate their alignment with emerging governance requirements. This pre-clinical playbook provides actionable guidance for development teams, accelerates the path to clinical evaluation, and establishes a shared vocabulary bridging AI researchers, healthcare practitioners, and regulatory stakeholders. By explicitly scoping what can be built and verified before clinical deployment, we aim to reduce friction in clinical AI translation while remaining cautious about what constitutes validated, deployed explainability.

医疗AI可解释性设计原则

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。