用扩散模型生成放射科报告,可反复修正内容,更贴近医生实际写作流程。
DRRG: A Discrete Diffusion Framework for Radiology Report Generation

- 采用迭代去噪机制,不再逐字生成,支持双向修正。
- 在MIMIC-CXR上多项指标优于主流方法,且模型更小。
- 加入临床实体关注掩码和图像概念注入,提升报告准确性。
自动放射科报告生成(RRG)旨在提升报告准确性和减轻医生负担。现有方法多基于自回归框架,逐词生成且无法修正早期内容,易产生错误传播,与医生反复推敲的写作习惯不符。本文提出基于离散扩散大语言模型(DLLM)的DRRG框架,将报告生成建模为迭代掩码去噪过程。通过引入临床实体感知的互补掩码增强关键信息监督,并设计概念条件模块将图像提取的临床概念注入视觉表征。DRRG在MIMIC-CXR和CheXpert Plus数据集上训练评估。结果表明,在MIMIC-CXR上,其BLEU-4达0.210,CheXpert-F1为0.549,RadGraph-F1为0.281,GREEN为0.360,RaTEScore为0.604,多数指标优于对比方法,且使用更小的LLM解码器;在CheXpert Plus上,其BLEU-4(0.119)和CheXpert-F1(0.347)均最高。结论:离散扩散提供了有效的替代方案,实现双向迭代优化,结合临床关注掩码与图像概念注入可显著提升报告质量与临床一致性。
原文摘要 · Abstract (English)
Purpose: Automatic radiology report generation (RRG) has been widely explored to improve reporting accuracy and reduce radiologists' workload. Most existing methods rely on autoregressive (AR) frameworks that generate reports token by token and cannot revise earlier content, making them prone to error propagation and inconsistent with the iterative refinement process of radiological reporting. In contrast, discrete diffusion large language models (DLLMs) generate text through iterative denoising, naturally enabling report refinement. However, DLLMs have not been extensively investigated for RRG. In this study, we developed and evaluated a discrete diffusion framework for RRG that enables iterative refinement rather than conventional left-to-right autoregressive decoding. Materials and methods: We developed DRRG, a DLLM-based framework that formulates RRG as iterative masked-token denoising. DRRG incorporates a clinical-entities-aware complementary mask to improve token supervision coverage and emphasize clinically important entities, together with a concept-conditioning module that injects image-derived clinical concepts into visual representations. DRRG was trained and evaluated on MIMIC-CXR and CheXpert Plus. Results: On MIMIC-CXR, DRRG achieved BLEU-4 of 0.210, CheXpert-F1 of 0.549, RadGraph-F1 of 0.281, GREEN of 0.360, and RaTEScore of 0.604, outperforming the compared methods on most reported metrics, despite employing a substantially smaller LLM decoder. On CheXpert Plus, DRRG achieved the highest BLEU-4 (0.119) and CheXpert-F1 (0.347) among the compared methods. Conclusion: Discrete diffusion provides an effective alternative to autoregressive radiology report generation by enabling iterative, bidirectional report refinement. Incorporating clinically focused masking and image-derived concept conditioning improves report quality and clinical consistency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。