构建3D影像与报告的多模态基准,评估报告修订的临床合理性。
RADAR: A Multimodal Benchmark for 3D Image-Based Radiology Report Review
- 基于腹部CT和医生修订流程,配对影像与初版报告及修改建议。
- 评估修改是否合理、临床严重程度及类型(修正/补充/澄清)。
- 适合研究医学AI辅助诊断审核与跨模态对齐的团队使用。
同一患者检查的放射科报告可能因解读差异、报告变异性或评估演变而存在临床意义的不一致。系统分析这些差异对质量保证、临床决策支持和多模态模型开发至关重要,但受限于缺乏标准化基准。我们提出RADAR,一个针对放射科报告差异分析的多模态基准,将3D医学影像与初步报告及对应的候选修改配对。数据集反映标准临床工作流程:住院医师撰写初步报告,主治医师审阅并修订。RADAR定义了结构化差异评估任务,要求模型判断修改的图像层面一致性、评估临床严重性,并分类编辑类型(修正、补充或澄清)。相比以往侧重二元错误检测或与独立参考报告比较的工作,RADAR聚焦报告审核阶段的细粒度临床推理与图文对齐。该基准包含专家标注的腹部CT检查,附有标准化评估协议,可支持多模态模型的系统性对比。RADAR为评估多模态系统作为报告修改审查者提供了临床基础测试平台。
原文摘要 · Abstract (English)
Radiology reports for the same patient examination may contain clinically meaningful discrepancies arising from interpretation differences, reporting variability, or evolving assessments. Systematic analysis of such discrepancies is important for quality assurance, clinical decision support, and multimodal model development, yet remains limited by the lack of standardized benchmarks. We present RADAR, a multimodal benchmark for radiology report discrepancy analysis that pairs 3D medical images with a preliminary report and corresponding candidate edits for the same study. The dataset reflects a standard clinical workflow in which trainee radiologists author preliminary reports that are subsequently reviewed and revised by attending radiologists. RADAR defines a structured discrepancy assessment task requiring models to evaluate proposed edits by determining image-level agreement, assessing clinical severity, and classifying edit type (correction, addition, or clarification). In contrast to prior work emphasizing binary error detection or comparison against fully independent reference reports, RADAR targets fine-grained clinical reasoning and image-text alignment at the report review stage. The benchmark consists of expert-annotated abdominal CT examinations and is accompanied by standardized evaluation protocols to support systematic comparison of multimodal models. RADAR provides a clinically grounded testbed for evaluating multimodal systems as reviewers of radiology report edits.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。