arXiv:2409.15260cs.AIcs.IR2024-09被引 4

用AI生成腰痛患者教育材料,虽更准确但尚不能临床使用

Generative AI Is Not Ready for Clinical Use in Patient Education for Lower Back Pain Patients, Even With Retrieval-Augmented Generation

  • 结合RAG与少量样本学习,生成个性化腰痛教育内容
  • 相比传统模型,新方法内容更准、更完整、可读性更高
  • 适合关注AI医疗应用的临床研究者与技术开发者

腰痛(LBP)是全球致残的主要原因。治疗后进行充分的患者教育对改善功能和长期预后至关重要。尽管患者教育策略不断进步,但为腰痛患者提供个性化、基于证据的信息仍存在显著差距。近年来,大语言模型(LLMs)和生成式人工智能(GenAI)在提升患者教育方面展现出潜力,但其在腰痛患者教育中的应用与效果仍待深入探索。本研究提出一种新颖方法,利用带有检索增强生成(RAG)和少量样本学习的LLM,生成针对腰痛患者的定制化教育材料。物理治疗师采用李克特量表对模型输出的重复性、准确性与完整性进行人工评估,并使用弗莱切阅读易度评分(Flesch Reading Ease score)评估可读性。结果显示,基于RAG的LLM优于传统模型,生成的内容更具准确性、完整性,且冗余更少、可读性更高。然而,分析表明生成内容仍不适合临床实践使用。本研究强调了结合RAG的AI模型在改善腰痛患者教育方面的潜力,但确保内容的临床相关性和细节精度仍是重大挑战。

原文摘要 · Abstract (English)

Low back pain (LBP) is a leading cause of disability globally. Following the onset of LBP and subsequent treatment, adequate patient education is crucial for improving functionality and long-term outcomes. Despite advancements in patient education strategies, significant gaps persist in delivering personalized, evidence-based information to patients with LBP. Recent advancements in large language models (LLMs) and generative artificial intelligence (GenAI) have demonstrated the potential to enhance patient education. However, their application and efficacy in delivering educational content to patients with LBP remain underexplored and warrant further investigation. In this study, we introduce a novel approach utilizing LLMs with Retrieval-Augmented Generation (RAG) and few-shot learning to generate tailored educational materials for patients with LBP. Physical therapists manually evaluated our model responses for redundancy, accuracy, and completeness using a Likert scale. In addition, the readability of the generated education materials is assessed using the Flesch Reading Ease score. The findings demonstrate that RAG-based LLMs outperform traditional LLMs, providing more accurate, complete, and readable patient education materials with less redundancy. Having said that, our analysis reveals that the generated materials are not yet ready for use in clinical practice. This study underscores the potential of AI-driven models utilizing RAG to improve patient education for LBP; however, significant challenges remain in ensuring the clinical relevance and granularity of content generated by these models.

AI医疗腰痛生成式AIRAG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。