arXiv:2410.03741cs.HCcs.AI2024-10被引 8

AI助手能帮普通心内科医生补齐罕见病诊疗短板,提升诊断质量。

Towards Democratization of Subspeciality Medical Expertise

  • 用大模型构建医学对话系统,结合搜索与自检增强诊断能力
  • 在10个评估维度中,5项表现优于普通心内科医生,整体质量显著提升
  • 适合需要快速获取专科建议的临床场景,尤其对资源匮乏地区有帮助

罕见、复杂且危及生命的疾病缺乏亚专科医疗专家,严重制约医疗服务质量,尤其在心脏病学领域,及时准确的诊疗直接影响患者预后。本文探索了基于大语言模型的AMIE(Articulate Medical Intelligence Explorer)系统在诊断对话中的应用潜力,旨在辅助临床决策。研究收集了204例真实亚专科心内科病例,涵盖心电图、超声心动图、心脏磁共振、基因检测和心肺运动试验等结果。采用由亚专科医生制定的十维评估量表,评估普通心内科医生与经网络检索和自我批判优化的AMIE生成的诊断与管理方案质量。结果显示,AMIE在5个维度上优于普通心内科医生(偏好度9%~20%),其余维度相当;在63.7%的病例中,医生参考AMIE后整体表现提升,仅3.4%下降。所有10个维度下,有AMIE支持的医生表现均优于无支持者。定性分析表明,AMIE全面敏感,医生简洁精准,二者可互补。总体表明,专业化医疗大模型有望弥补普通医生在亚专科知识上的不足,但其广泛应用仍需进一步研究与验证。

原文摘要 · Abstract (English)

The scarcity of subspecialist medical expertise, particularly in rare, complex and life-threatening diseases, poses a significant challenge for healthcare delivery. This issue is particularly acute in cardiology where timely, accurate management determines outcomes. We explored the potential of AMIE (Articulate Medical Intelligence Explorer), a large language model (LLM)-based experimental AI system optimized for diagnostic dialogue, to potentially augment and support clinical decision-making in this challenging context. We curated a real-world dataset of 204 complex cases from a subspecialist cardiology practice, including results for electrocardiograms, echocardiograms, cardiac MRI, genetic tests, and cardiopulmonary stress tests. We developed a ten-domain evaluation rubric used by subspecialists to evaluate the quality of diagnosis and clinical management plans produced by general cardiologists or AMIE, the latter enhanced with web-search and self-critique capabilities. AMIE was rated superior to general cardiologists for 5 of the 10 domains (with preference ranging from 9% to 20%), and equivalent for the rest. Access to AMIE's response improved cardiologists' overall response quality in 63.7% of cases while lowering quality in just 3.4%. Cardiologists' responses with access to AMIE were superior to cardiologist responses without access to AMIE for all 10 domains. Qualitative examinations suggest AMIE and general cardiologist could complement each other, with AMIE thorough and sensitive, while general cardiologist concise and specific. Overall, our results suggest that specialized medical LLMs have the potential to augment general cardiologists' capabilities by bridging gaps in subspecialty expertise, though further research and validation are essential for wide clinical utility.

医疗AI大模型心脏病学辅助诊断

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。