用对话式AI实现无代码个性化风险评估,新冠重症预测效果优于传统模型。
Generative LLM Powered Conversational AI Application for Personalized Risk Assessment: A Case Study in COVID-19
- 通过对话交互实时收集信息,无需编程即可完成风险评估。
- 仅用少量样本微调,生成式LLM在新冠重症预测上达到高AUC值。
- 可解释的注意力分析助力临床决策,适合医疗场景快速部署。
大型语言模型(LLMs)在自然语言任务中表现卓越,正逐步应用于医疗领域。本文提出一种基于流式人机对话的LLM驱动疾病风险评估新方法,避免了传统机器学习所需的编程需求。在新冠重症风险评估案例研究中,我们使用少量自然语言示例对预训练生成式LLM(如Llama2-7b和Flan-t5-xl)进行微调,并与基于表格数据从头训练的传统分类器(逻辑回归、XGBoost、随机森林)在多种实验设置下进行对比。我们开发了一款移动应用,以微调后的LLM作为生成式AI核心,支持临床医生与患者实时交互,实现无代码风险评估。该系统不仅支持流式问答输入,还利用LLM注意力层提供个性化特征重要性分析,增强评估可解释性。在有限微调样本条件下,生成式LLM取得高面积曲线下(AUC)得分,表明其在低数据场景下超越判别式分类方法的潜力,凸显其实际适应性和有效性。本工作旨在填补生成式LLM在交互式无代码风险评估中的应用空白,推动该新兴领域的研究发展。
原文摘要 · Abstract (English)
Large language models (LLMs) have shown remarkable capabilities in various natural language tasks and are increasingly being applied in healthcare domains. This work demonstrates a new LLM-powered disease risk assessment approach via streaming human-AI conversation, eliminating the need for programming required by traditional machine learning approaches. In a COVID-19 severity risk assessment case study, we fine-tune pre-trained generative LLMs (e.g., Llama2-7b and Flan-t5-xl) using a few shots of natural language examples, comparing their performance with traditional classifiers (i.e., Logistic Regression, XGBoost, Random Forest) that are trained de novo using tabular data across various experimental settings. We develop a mobile application that uses these fine-tuned LLMs as its generative AI (GenAI) core to facilitate real-time interaction between clinicians and patients, providing no-code risk assessment through conversational interfaces. This integration not only allows for the use of streaming Questions and Answers (QA) as inputs but also offers personalized feature importance analysis derived from the LLM's attention layers, enhancing the interpretability of risk assessments. By achieving high Area Under the Curve (AUC) scores with a limited number of fine-tuning samples, our results demonstrate the potential of generative LLMs to outperform discriminative classification methods in low-data regimes, highlighting their real-world adaptability and effectiveness. This work aims to fill the existing gap in leveraging generative LLMs for interactive no-code risk assessment and to encourage further research in this emerging field.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。