arXiv:2607.03853cs.CV2026-07

模仿医生阅读流程,分四步生成更准确的放射科报告。

CogRad: A Cognitively-Inspired Multi-Agent Framework for Radiology Report Generation

论文配图:CogRad: A Cognitively-Inspired Multi-Agent Framework for Radiology Report Generation
图 1 · 摘自论文原文
  • 用四个智能体模拟医生读片:搜寻、探查、写作、验证。
  • 在两个数据集上超越现有方法,尤其在报告真实性上表现优异。
  • 适合关注医疗文本生成可信度的研究者与临床应用开发者。

自动化放射科报告生成可减轻放射科医生负担,但现有系统多采用单次前向传播生成报告,缺乏对图像内容的核查或对已陈述发现的回溯修正机制。我们提出CogRad,一种受认知启发的多智能体框架,将生成过程结构化为四个类似放射科医生读片阶段的步骤:侦察者智能体通过槽注意力直接从图像块中发现解剖区域,并分配区域与疾病级分诊评分;探查者智能体集中表示能力于侦察者标记为可疑的区域;写作者智能体将这些信号整合为大语言模型的疾病门控视觉前缀;验证者智能体在训练中使用视觉蕴含损失进行监督,并在推理时逐句重新审视自身草稿,对证据不足的段落进行重生成。在CheXpert Plus上,CogRad达到BLEU-4为0.316、CIDEr为0.322,优于对比的所有方法;在IU X-Ray上,其BLEU-4为0.201,CIDEr为0.724,在所有标准自然语言生成指标上均领先基线。我们进一步通过RadGraph F1、CheXbert F1及幻觉分析评估临床准确性,弥补传统文本重叠指标的不足,并通过消融实验和Grad-CAM可视化揭示各智能体贡献与模型的视觉依存性。

原文摘要 · Abstract (English)

Automated radiology report generation (RRG) can ease radiologist workload, yet most existing systems produce a report in a single forward pass, with no mechanism to check a claim against the image or revisit a finding once stated. We present CogRad, a cognitively inspired multi-agent framework that structures generation around four stages of a radiologist's reading process. A Scout agent discovers anatomical regions directly from image patches via slot attention and assigns region and disease-level triage scores; an Investigator agent concentrates representational capacity on the regions Scout flags as suspicious; a Writer agent compiles these signals into a disease gated visual prefix for a large language model; and a Verifier agent supervises training with a visual entailment loss and, at inference, re-examines its own draft sentence by sentence, regenerating any report it judges insufficiently grounded. On CheXpert Plus, CogRad attains a BLEU-4 of 0.316 and a CIDEr of 0.322, the best scores among the methods we compare against. On IU X-Ray, it attains a BLEU-4 of 0.201 and a CIDEr of 0.724, leading every baseline on every standard NLG metric. We further evaluate CogRad with RadGraph F1, CheXbert F1, and a hallucination analysis to assess clinical accuracy beyond standard text-overlap metrics, complemented by ablation studies and Grad-CAM-based visualizations that characterize each agent's contribution and the model's visual grounding.

医学报告生成多智能体视觉推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。