arXiv:2504.11786cs.CV2025-04CVPR被引 10

让报告生成更准确:用疾病感知对齐+自修正,提升放射科报告可信度

DART: Disease-aware Image-Text Alignment and Self-correcting Re-alignment for Trustworthy Radiology Report Generation

  • 通过疾病匹配的图像-文本对比学习,确保检索到相关病灶的报告
  • 自修正模块使生成报告与影像进一步对齐,在两个数据集上达顶尖性能
  • 适合临床辅助诊断系统开发者,提升AI报告可信度

自动生成放射科报告已成为减轻耗时工作、准确捕捉X光片中关键疾病信息的有前景方案。以往方法表现优异,但仍有提升空间:需确保检索报告包含与影像一致的疾病相关发现,并优化生成报告质量。本文提出疾病感知图像-文本对齐与自修正重对齐框架(DART)。第一阶段基于图像-文本检索生成初始报告,通过对比学习将图像与文本嵌入共享空间,实现疾病匹配;第二阶段引入自修正模块,重新对齐报告与影像内容。该框架在两个常用基准上均达到当前最优性能,显著提升报告生成效果与临床有效性指标,增强放射科报告的可信度。

原文摘要 · Abstract (English)

The automatic generation of radiology reports has emerged as a promising solution to reduce a time-consuming task and accurately capture critical disease-relevant findings in X-ray images. Previous approaches for radiology report generation have shown impressive performance. However, there remains significant potential to improve accuracy by ensuring that retrieved reports contain disease-relevant findings similar to those in the X-ray images and by refining generated reports. In this study, we propose a Disease-aware image-text Alignment and self-correcting Re-alignment for Trustworthy radiology report generation (DART) framework. In the first stage, we generate initial reports based on image-to-text retrieval with disease-matching, embedding both images and texts in a shared embedding space through contrastive learning. This approach ensures the retrieval of reports with similar disease-relevant findings that closely align with the input X-ray images. In the second stage, we further enhance the initial reports by introducing a self-correction module that re-aligns them with the X-ray images. Our proposed framework achieves state-of-the-art results on two widely used benchmarks, surpassing previous approaches in both report generation and clinical efficacy metrics, thereby enhancing the trustworthiness of radiology reports.

放射科报告图像文本对齐自修正

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。