arXiv:2409.18968cs.CYcs.AI2024-09被引 20

大语言模型让医疗AI更高效,但也带来安全新挑战。

Safety challenges of AI in medicine in the era of large language models

  • 从数据到应用全链条分析LLM在医疗中的安全风险
  • 指出超人类表现反而加剧公众对AI安全的担忧
  • 适合关注AI医疗落地与信任构建的研究者和从业者

近年来,人工智能(AI)特别是大语言模型(LLMs)的进展为提升医疗质量和效率带来了巨大潜力。通过自然语言交互,LLMs为医护人员、患者和研究人员提供了新的可能性。然而,随着AI和LLMs日益强大,尤其在某些医疗任务中达到超人表现,公众对其安全性的担忧显著加剧。这些安全问题已成为阻碍AI在医疗领域采纳的最重要障碍。本文综述了大语言模型时代医疗AI使用中的新兴风险:首先从功能和沟通角度探讨了模型特有安全挑战,涵盖数据收集、模型训练到实际应用各环节;其次分析了所有AI系统共有的固有安全问题,以及由LLMs引入的额外复杂性;最后讨论了临床实践和医疗系统运营中使用AI所引发的安全问题如何损害患者、医生和公众的信任,并提出建立信心的路径。强调安全AI的发展,将有助于这些技术更快、更可靠地融入日常医疗实践,惠及患者与医护人员。

原文摘要 · Abstract (English)

Recent advancements in artificial intelligence (AI), particularly in large language models (LLMs), have unlocked significant potential to enhance the quality and efficiency of medical care. By introducing a novel way to interact with AI and data through natural language, LLMs offer new opportunities for medical practitioners, patients, and researchers. However, as AI and LLMs become more powerful and especially achieve superhuman performance in some medical tasks, public concerns over their safety have intensified. These concerns about AI safety have emerged as the most significant obstacles to the adoption of AI in medicine. In response, this review examines emerging risks in AI utilization during the LLM era. First, we explore LLM-specific safety challenges from functional and communication perspectives, addressing issues across data collection, model training, and real-world application. We then consider inherent safety problems shared by all AI systems, along with additional complications introduced by LLMs. Last, we discussed how safety issues of using AI in clinical practice and healthcare system operation would undermine trust among patient, clinicians and the public, and how to build confidence in these systems. By emphasizing the development of safe AI, we believe these technologies can be more rapidly and reliably integrated into everyday medical practice to benefit both patients and clinicians.

AI医疗大模型安全挑战信任机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。