通过临床共识筛选提升医学影像报告生成质量
CCS: Clinical Consensus Selection for Radiology Report Generation

- 生成多份报告后,选临床一致性最高的
- 在三个数据集上显著提升临床指标
- 适合关注报告真实性的医疗AI研究者
放射科报告生成(RRG)通常采用单路径生成方式,由多模态大语言模型(MLLM)输出单一报告。尽管近期进展主要依赖扩大训练数据、模型容量和检索机制,但推理阶段的报告质量优化仍被忽视。本工作发现,固定放射科MLLM在候选报告池中常存在临床质量更高的报告,而默认解码方式未能选取。为此,我们提出临床共识选择(CCS)框架,该框架在不依赖具体解码器的前提下,采样多个候选报告,并基于文本与图像-报告联合训练的多模态嵌入器选出临床一致性最高的报告。该方法融合文本相似性与图像引导的语义一致性,跨三个数据集和多个辐射科MLLM均优于单路径解码和通用Best-of-N基线,尤其在临床评价指标上表现突出。分析表明,图像引导的评估维度独立于文本共识,且报告生成在推理阶段仍有显著提升空间。
原文摘要 · Abstract (English)
Radiology report generation (RRG) is commonly formulated as a single-path generation task, where a multimodal large language model (MLLM) produces one decoded report as the final output. While recent progress has largely been driven by scaling training data, model capacity, and retrieval mechanisms, improving report quality at inference time remains underexplored. In this work, we observe that fixed radiology MLLMs often generate clinically stronger reports elsewhere in their candidate pool than the one selected by default decoding, suggesting that inference-time decision making remains an overlooked bottleneck. To address this, we propose Clinical Consensus Selection (CCS), a decoder-agnostic inference-time selection framework that samples multiple candidate reports and selects the one with the highest clinical consensus across the rollout pool. CCS unifies text-based utilities with a radiology-adapted utility computed by an image--report-trained multimodal embedder, which measures candidate agreement beyond surface-level textual similarity. Across three datasets and multiple radiology MLLMs, CCS consistently improves inference-time performance over single-path decoding and generic Best-of-N baselines, with particularly clear gains on clinical metrics. Further analysis shows that image-grounded utility forms a selection axis distinct from textual consensus and that substantial headroom remains for improving RRG at inference time.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。