让医生异步监督AI问诊,提升效率与决策质量。
Towards physician-centered oversight of conversational diagnostic AI
- 构建多智能体系统g-AMIE,在安全约束下完成病史采集
- 60个场景测试中,其问诊质量高于护士或医生团队
- 医生异步监督比独立问诊更省时,适合临床落地
近期研究展示了对话式AI在诊断对话中的潜力。然而,实际医疗安全要求个体化诊断和治疗方案由持证专业人士监管。医生常负责监督其他团队成员(如执业护士或助理医师)的诊疗活动。受此启发,本文提出一种面向医生主导的异步监督框架,用于艺术化医疗智能探索者(AMIE)AI系统。我们设计了受控版g-AMIE,一个在安全边界内执行病史采集的多智能体系统,不提供个性化医疗建议。随后,g-AMIE将评估结果以临床仪表板形式传送给主治医生(PCP),由其进行监督并保留临床决策责任。该机制实现问诊与监督解耦,支持异步操作。在60个虚拟客观结构化临床考试(OSCE)文本咨询场景中,对比了在相同安全约束下的g-AMIE、执业护士/助理医师组及医生组。结果显示,g-AMIE在高质量问诊、病例总结、诊断与管理计划生成方面均优于两组,最终决策质量更高。此外,医生对g-AMIE的监督比以往独立医生问诊更高效。尽管本研究未完全复制真实临床流程,且可能低估了医生能力,但结果证明异步监督是可行的诊断AI运行范式,有助于提升现实医疗质量。
原文摘要 · Abstract (English)
Recent work has demonstrated the promise of conversational AI systems for diagnostic dialogue. However, real-world assurance of patient safety means that providing individual diagnoses and treatment plans is considered a regulated activity by licensed professionals. Furthermore, physicians commonly oversee other team members in such activities, including nurse practitioners (NPs) or physician assistants/associates (PAs). Inspired by this, we propose a framework for effective, asynchronous oversight of the Articulate Medical Intelligence Explorer (AMIE) AI system. We propose guardrailed-AMIE (g-AMIE), a multi-agent system that performs history taking within guardrails, abstaining from individualized medical advice. Afterwards, g-AMIE conveys assessments to an overseeing primary care physician (PCP) in a clinician cockpit interface. The PCP provides oversight and retains accountability of the clinical decision. This effectively decouples oversight from intake and can thus happen asynchronously. In a randomized, blinded virtual Objective Structured Clinical Examination (OSCE) of text consultations with asynchronous oversight, we compared g-AMIE to NPs/PAs or a group of PCPs under the same guardrails. Across 60 scenarios, g-AMIE outperformed both groups in performing high-quality intake, summarizing cases, and proposing diagnoses and management plans for the overseeing PCP to review. This resulted in higher quality composite decisions. PCP oversight of g-AMIE was also more time-efficient than standalone PCP consultations in prior work. While our study does not replicate existing clinical practices and likely underestimates clinicians' capabilities, our results demonstrate the promise of asynchronous oversight as a feasible paradigm for diagnostic AI systems to operate under expert human oversight for enhancing real-world care.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。