用多角度摘要提升精神科患者30天再入院预测效果
Aspect-Oriented Summarization for Psychiatric Short-Term Readmission Prediction
- 用不同视角提示词生成多份摘要,捕捉原文不同信息
- 融合多摘要信号后,再入院预测准确率显著提升
- 适合医疗文本分析与LLM下游任务优化的研究者
大语言模型虽能处理长文档而无需特定任务标注数据,但在复杂任务中零样本性能仍不足。针对长文档处理,可先摘要再微调,但摘要会损失信息。本研究提出一种面向不同重要方面的摘要处理方法:假设使用不同视角提示词生成的摘要包含不同信息信号,提出测量这些差异的方法,并有效整合多摘要信号用于变压器模型的监督微调。在来自四家医院的真实精神科出院记录上验证该方法,任务为30天再入院预测,结果表明该方法显著提升了复杂预测任务的性能。
原文摘要 · Abstract (English)
Recent progress in large language models (LLMs) has enabled the automated processing of lengthy documents even without supervised training on a task-specific dataset. Yet, their zero-shot performance in complex tasks as opposed to straightforward information extraction tasks remains suboptimal. One feasible approach for tasks with lengthy, complex input is to first summarize the document and then apply supervised fine-tuning to the summary. However, the summarization process inevitably results in some loss of information. In this study we present a method for processing the summaries of long documents aimed to capture different important aspects of the original document. We hypothesize that LLM summaries generated with different aspect-oriented prompts contain different information signals, and we propose methods to measure these differences. We introduce approaches to effectively integrate signals from these different summaries for supervised training of transformer models. We validate our hypotheses on a high-impact task -- 30-day readmission prediction from a psychiatric discharge -- using real-world data from four hospitals, and show that our proposed method increases the prediction performance for the complex task of predicting patient outcome.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。