arXiv:2502.04356cs.CLcs.AI2025-02被引 6

开源大模型结合检索增强,可实现媲美闭源模型的个性化处方生成。

Open Foundation Models in Healthcare: Challenges, Paradoxes, and Opportunities with GenAI Driven Personalized Prescription

  • 用检索增强生成(RAG)提升开源模型在医疗任务中的表现。
  • 开源模型经RAG加持后,个性化处方生成性能接近闭源模型。
  • 适合关注医疗AI透明性与安全性的研究者和临床开发者。

受闭源大模型(如GPT-4)成功启发,学术与非商业领域对开源大语言模型(LLM)和人工智能基础模型(AIFM)的兴趣日益增长。尽管其功能尚不及闭源模型成熟,但开源模型在医疗应用中潜力巨大。本文系统梳理当前开源医疗LLM与AIFM的进展,提出一套分类体系,按任务类型划分其应用场景。进一步通过个性化处方生成案例研究,评估开源模型通用能力。实验对比了有无检索增强生成(RAG)条件下开源与闭源模型的表现。结果表明,虽整体性能稍逊,但结合RAG后,开源模型在个性化处方生成任务上可达到与闭源模型相当的水平。专家临床评估验证了该方法的临床价值。同时,文章讨论了模型滥用带来的伦理风险,强调需谨慎、负责任地推进医疗AI落地。

原文摘要 · Abstract (English)

In response to the success of proprietary Large Language Models (LLMs) such as OpenAI's GPT-4, there is a growing interest in developing open, non-proprietary LLMs and AI foundation models (AIFMs) for transparent use in academic, scientific, and non-commercial applications. Despite their inability to match the refined functionalities of their proprietary counterparts, open models hold immense potential to revolutionize healthcare applications. In this paper, we examine the prospects of open-source LLMs and AIFMs for developing healthcare applications and make two key contributions. Firstly, we present a comprehensive survey of the current state-of-the-art open-source healthcare LLMs and AIFMs and introduce a taxonomy of these open AIFMs, categorizing their utility across various healthcare tasks. Secondly, to evaluate the general-purpose applications of open LLMs in healthcare, we present a case study on personalized prescriptions. This task is particularly significant due to its critical role in delivering tailored, patient-specific medications that can greatly improve treatment outcomes. In addition, we compare the performance of open-source models with proprietary models in settings with and without Retrieval-Augmented Generation (RAG). Our findings suggest that, although less refined, open LLMs can achieve performance comparable to proprietary models when paired with grounding techniques such as RAG. Furthermore, to highlight the clinical significance of LLMs-empowered personalized prescriptions, we perform subjective assessment through an expert clinician. We also elaborate on ethical considerations and potential risks associated with the misuse of powerful LLMs and AIFMs, highlighting the need for a cautious and responsible implementation in healthcare.

开源模型医疗AI个性化处方RAG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。