arXiv:2503.05750cs.CLcs.AI2025-03ACL被引 1

用上下文驱动的序列迁移学习,提升放射科报告摘要的准确性和连贯性。

CSTRL: Context-Driven Sequential Transfer Learning for Abstractive Radiology Report Summarization

  • 基于上下文感知的序列迁移学习,精准提取关键诊断信息。
  • 在MIMIC-CXR和Open-I数据集上,多项指标领先基准模型20%以上。
  • 适合医疗文本生成、临床辅助诊断系统开发者参考。

放射科报告包含多个部分,如发现和诊断意见。从发现部分自动生成诊断意见对减轻放射科医生负担、提高诊断准确性至关重要。通用抽象摘要预训练模型在医学领域表现不佳,主要因术语复杂且需保持精确临床语境。此类任务需准确提取核心信息、避免语境偏移并保持逻辑连贯,术语误用可能导致严重临床错误。为此,我们提出一种序列迁移学习方法,通过费舍尔矩阵正则化解决初始参数衰减与知识丢失问题,确保关键内容提取与连贯摘要生成。在MIMIC-CXR和Open-I数据集上,所提模型CSTRL(Context-driven Sequential TRansfer Learning)达到当前最优性能:相比基准研究,BLEU-1提升56.2%,BLEU-2提升40.5%,BLEU-3提升84.3%,ROUGE-1提升28.9%,ROUGE-2提升41.0%,ROUGE-3提升26.5%。同时分析了事实一致性评分以保障医学语境完整性。代码已公开于https://github.com/fahmidahossain/Report_Summarization。

原文摘要 · Abstract (English)

A radiology report comprises several sections, including the Findings and Impression of the diagnosis. Automatically generating the Impression from the Findings is crucial for reducing radiologists' workload and improving diagnostic accuracy. Pretrained models that excel in common abstractive summarization problems encounter challenges when applied to specialized medical domains largely due to the complex terminology and the necessity for accurate clinical context. Such tasks in medical domains demand extracting core information, avoiding context shifts, and maintaining proper flow. Misuse of medical terms can lead to drastic clinical errors. To address these issues, we introduce a sequential transfer learning that ensures key content extraction and coherent summarization. Sequential transfer learning often faces challenges like initial parameter decay and knowledge loss, which we resolve with the Fisher matrix regularization. Using MIMIC-CXR and Open-I datasets, our model, CSTRL - Context-driven Sequential TRansfer Learning - achieved state-of-the-art performance, showing 56.2% improvement in BLEU-1, 40.5% in BLEU-2, 84.3% in BLEU-3, 28.9% in ROUGE-1, 41.0% in ROUGE-2 and 26.5% in ROGUE-3 score over benchmark studies. We also analyze factual consistency scores while preserving the medical context. Our code is publicly available at https://github.com/fahmidahossain/Report_Summarization.

医疗生成序列建模摘要生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。