用专用大模型自动回复前列腺癌患者咨询,减轻医护负担。
Retrospective Comparative Analysis of Prostate Cancer In-Basket Messages: Responses from Closed-Domain LLM vs. Clinical Teams
- 基于GPT-4构建放射肿瘤专用模型RadOnc-GPT,结合电子病历数据。
- 在158条消息上测试,提升清晰度与共情力,节省医护每条5.2分钟。
- 适合医疗AI研发者、医院管理者,助力临床提效降本。
医患沟通中的入篮消息(in-basket messages)贯穿患者诊疗全程,但回复耗时长,加重临床工作负担。为此,我们提出专用于前列腺癌放疗的RadOnc-GPT模型,基于GPT-4并采用先进提示工程,集成医院级及放疗专科电子病历数据库。在158条历史入篮消息上评估,通过自然语言处理分析及医护双盲评分,结果显示该模型在“清晰度”和“共情”上略优于临床团队,在“完整性”和“正确性”上相当。预计可为护士节省每条消息5.2分钟,为医生节省2.4分钟。使用RadOnc-GPT生成回复草稿,有望显著减轻临床团队负担并降低医疗成本。
原文摘要 · Abstract (English)
In-basket message interactions play a crucial role in physician-patient communication, occurring during all phases (pre-, during, and post) of a patient's care journey. However, responding to these patients' inquiries has become a significant burden on healthcare workflows, consuming considerable time for clinical care teams. To address this, we introduce RadOnc-GPT, a specialized Large Language Model (LLM) powered by GPT-4 that has been designed with a focus on radiotherapeutic treatment of prostate cancer with advanced prompt engineering, and specifically designed to assist in generating responses. We integrated RadOnc-GPT with patient electronic health records (EHR) from both the hospital-wide EHR database and an internal, radiation-oncology-specific database. RadOnc-GPT was evaluated on 158 previously recorded in-basket message interactions. Quantitative natural language processing (NLP) analysis and two grading studies with clinicians and nurses were used to assess RadOnc-GPT's responses. Our findings indicate that RadOnc-GPT slightly outperformed the clinical care team in "Clarity" and "Empathy," while achieving comparable scores in "Completeness" and "Correctness." RadOnc-GPT is estimated to save 5.2 minutes per message for nurses and 2.4 minutes for clinicians, from reading the inquiry to sending the response. Employing RadOnc-GPT for in-basket message draft generation has the potential to alleviate the workload of clinical care teams and reduce healthcare costs by producing high-quality, timely responses.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。