arXiv:2412.03593cs.CLcs.AI2024-12被引 2

用大模型预测新冠患者病情严重程度和临床结局,自动处理缺失数据。

CovidLLM: A Robust Large Language Model with Missing Value Adaptation and Multi-Objective Learning Strategy for Predicting Disease Severity and Clinical Outcomes in COVID-19 Patients

  • 通过设计特殊提示让大模型理解数据缺失,无需传统填补方法。
  • 多目标学习使病情预测与临床结局预测相互促进,提升整体效果。
  • 适用于高风险人群早期预警,适合医疗AI研究者参考。

2019年爆发的新冠肺炎已导致全球数百万人死亡。尽管疫苗可减轻重症症状,但老年人及有基础疾病者仍面临严重后果和高死亡率。因此,早期识别此类患者的病情严重程度与临床结局至关重要。现有机器学习与深度学习模型虽广泛应用,但大语言模型(LLM)在此领域的潜力尚未被充分探索。本研究聚焦于构建特定提示并采用多目标学习策略,选取与临床结局和疾病严重程度显著相关的血清学指标作为输入。由于血检数据常含大量缺失值,传统模型依赖插补处理,而大模型可通过提示机制直接理解缺失信息,无需插补。多目标学习中,模型先预测病情严重程度,再基于此预测临床结局;利用生成过程中前后文信息,两个任务相互增强。实验基于ChatGLM模型进行,结果表明大模型在该任务中表现有效,展现出良好应用前景。

原文摘要 · Abstract (English)

Coronavirus Disease 2019 (COVID-19), which emerged in 2019, has caused millions of deaths worldwide. Although effective vaccines have been developed to mitigate severe symptoms, certain populations, particularly the elderly and those with comorbidities, remain at high risk for severe outcomes and increased mortality. Consequently, early identification of the severity and clinical outcomes of the disease in these patients is vital to prevent adverse prognoses. Although traditional machine learning and deep learning models have been widely employed in this area, the potential of large language models (LLMs) remains largely unexplored. Our research focuses primarily on constructing specialized prompts and adopting multi-objective learning strategies. We started by selecting serological indicators that significantly correlate with clinical outcomes and disease severity to serve as input data for the model. Blood test samples often contain numerous missing values, and traditional models generally rely on imputation to handle these gaps in the data. In contrast, LLMs offer the advantage of robust semantic understanding. By setting prompts, we can explicitly inform the model when a feature's value is missing, without the need for imputation. For the multi-objective learning strategy, the model is designed to first predict disease severity and then predict clinical outcomes. Given that LLMs utilize both the input text and the generated tokens as input for generating the next token, the predicted severity is used as a basis for generating the clinical outcome. During the fine-tuning of the LLM, the two objectives influence and improve each other. Our experiments were implemented based on the ChatGLM model. The results demonstrate the effectiveness of LLMs in this task, suggesting promising potential for further development.

大模型医疗预测多任务学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。