让医学报告生成更符合临床逻辑,提升诊断一致性。
RadHiera: Semantic Hierarchical Reinforcement Learning for Medical Report Generation
- 分三阶段优化:整体质量→诊断准确性→前后文一致性
- 关键错误(如漏诊)权重更高,减少误判和夸大
- 用专家模型标签约束,防止报告自相矛盾
视觉语言模型在放射科报告生成中表现优异。但现有方法通常将报告视为扁平文本,未显式建模发现与印象之间的语义依赖,易导致临床观察与诊断结论不一致。本文提出RadHiera,一种面向放射科报告生成的语义层次强化学习框架。该框架遵循放射科报告的语义结构:先优化整体报告质量,再提升印象部分的诊断准确性,最后强制发现与印象间的一致性,确保诊断结论有临床证据支持。具体而言,首先使用结合语言质量和医学事实性的基础奖励进行全报告监督;在此基础上,引入严重性感知奖励,对涉及临床关键病症的错误给予更高权重,降低漏诊和过度描述风险;进一步通过专家模型生成的标签集施加子集约束与幻觉惩罚,确保印象忠实于发现。在三个公开胸片基准数据集上的实验表明,RadHiera在诊断准确性和跨部分一致性上均优于当前最优方法,且在超声报告生成中也展现出良好适应性。
原文摘要 · Abstract (English)
Vision-language models have shown promising results in radiology report generation. However, most existing methods generate reports as flat text and do not explicitly model the semantic dependency between the Findings and Impression sections, which can lead to inconsistencies between clinical observations and diagnostic conclusions. In this paper, we propose RadHiera, a semantic hierarchical reinforcement learning framework for radiology report generation. RadHiera follows the semantic organization of radiology reports by first optimizing overall report quality, then improving the diagnostic accuracy of the Impression section, and finally enforcing consistency between Findings and Impression so that diagnostic conclusions are supported by clinical evidence. Specifically, we begin with a base reward that combines linguistic quality and medical factuality to provide supervision on the whole report. On this basis, we introduce a severity-aware reward for the Impression section that places greater emphasis on errors involving clinically critical conditions, thereby reducing both missed diagnoses and overstatement. We further enforce cross-section consistency using Expert Model-derived label sets, with subset constraints and hallucination penalties to ensure that impressions remain faithful to the findings. Experiments on three public chest X-ray benchmarks show that RadHiera consistently improves diagnostic accuracy and inter-section consistency over state-of-the-art methods, while also demonstrating good adaptability to report generation in ultrasound report generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。