arXiv:2508.05353cs.CVcs.AI2025-08AAAI被引 12

利用患者病史和影像先验信息提升胸部X光报告生成质量

PriorRG: Prior-Guided Contrastive Pre-training and Coarse-to-Fine Decoding for Chest X-ray Report Generation

  • 通过先验引导对比预训练,对齐影像与临床语义
  • 在MIMIC-CXR上提升3.6% BLEU-4,MIMIC-ABN上提升5.9% BLEU-1
  • 适合关注临床可解释性与疾病进展追踪的医疗AI研究者

胸部X光报告生成旨在通过自动生成初步报告减轻放射科医生负担。现有方法多仅依赖单张图像,忽视了患者特有的先验知识——如症状、病史及最近的影像资料,而这些正是放射科医生进行诊断推理的关键。为此,我们提出PriorRG框架,模拟真实临床流程,采用两阶段训练:第一阶段引入先验引导的对比预训练,利用临床上下文指导时空特征提取,使模型更贴近放射科报告中的内在时空语义;第二阶段采用先验感知的粗到细解码,逐步融合患者先验知识与视觉编码器隐藏状态,使模型聚焦诊断重点并追踪疾病进展,从而提升生成报告的临床准确性和流畅度。在MIMIC-CXR和MIMIC-ABN数据集上的实验表明,PriorRG显著优于现有方法,在MIMIC-CXR上实现3.6%的BLEU-4和3.8%的F1分数提升,在MIMIC-ABN上取得5.9%的BLEU-1增益。代码与模型权重将在接受后公开。

原文摘要 · Abstract (English)

Chest X-ray report generation aims to reduce radiologists' workload by automatically producing high-quality preliminary reports. A critical yet underexplored aspect of this task is the effective use of patient-specific prior knowledge -- including clinical context (e.g., symptoms, medical history) and the most recent prior image -- which radiologists routinely rely on for diagnostic reasoning. Most existing methods generate reports from single images, neglecting this essential prior information and thus failing to capture diagnostic intent or disease progression. To bridge this gap, we propose PriorRG, a novel chest X-ray report generation framework that emulates real-world clinical workflows via a two-stage training pipeline. In Stage 1, we introduce a prior-guided contrastive pre-training scheme that leverages clinical context to guide spatiotemporal feature extraction, allowing the model to align more closely with the intrinsic spatiotemporal semantics in radiology reports. In Stage 2, we present a prior-aware coarse-to-fine decoding for report generation that progressively integrates patient-specific prior knowledge with the vision encoder's hidden states. This decoding allows the model to align with diagnostic focus and track disease progression, thereby enhancing the clinical accuracy and fluency of the generated reports. Extensive experiments on MIMIC-CXR and MIMIC-ABN datasets demonstrate that PriorRG outperforms state-of-the-art methods, achieving a 3.6% BLEU-4 and 3.8% F1 score improvement on MIMIC-CXR, and a 5.9% BLEU-1 gain on MIMIC-ABN. Code and checkpoints will be released upon acceptance.

医学报告生成先验引导胸部X光多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。