arXiv:2606.25894cs.CVcs.AI2026-06

让脑部MRI诊断模型像医生一样标注病灶并自我验证,提升准确性与可信度。

Enhancing Brain MRI Anomaly Detection and Reasoning with ROI Rethink and Synthetic Data

论文配图:Enhancing Brain MRI Anomaly Detection and Reasoning with ROI Rethink and Synthetic Data
图 1 · 摘自论文原文
  • 先提假设再标记病灶区域,通过重检证据验证结论。
  • 在内部数据集上诊断准确率达45.26%,误报减少45.7%。
  • 适合需要可解释性、低幻觉的临床辅助诊断场景。

医学视觉-语言模型通常通过单次推理生成诊断,但不指明支持结论的图像区域,导致结果难以审计,且可能在正常扫描中虚构病灶。本文提出BrReMark(Brain Rethink via ROI Marking)框架,引入显式区域标记机制:模型先生成异常假设并用边界框标记可疑区域,再重新检查标记证据以验证结论。训练结合结构化推理轨迹的监督微调与基于定位精度和诊断推理复合奖励的强化学习。此外,采用基于领域随机化的病理合成增强策略,提升模型对分布外(OOD)数据的泛化能力。在内部基准测试中,BrReMark将mAP50从0.74%提升至37.54%,临床F1达21.57%,诊断准确率达45.26%。在NOVA OOD基准上,相比最先进方法,假阳性降低45.7%,表明对罕见病灶的幻觉显著减少。结果表明,显式假设-验证的定位机制是实现可信开放域脑部MRI诊断的有效路径。

原文摘要 · Abstract (English)

Medical vision-language models typically generate diagnoses through single-pass inference without indicating which image regions support their conclusions. This lack of spatial grounding limits clinical utility: outputs cannot be audited, and models may hallucinate findings on normal scans. We present BrReMark (Brain Rethink via ROI Marking), a framework that introduces explicit region marking into brain MRI diagnosis. The model first generates hypotheses about potential abnormalities and grounds them through explicit bounding box marking, then verifies conclusions by re-examining the marked evidence. Training combines supervised fine-tuning on structured reasoning trajectories with reinforcement learning using a composite reward over localization accuracy and diagnostic reasoning. Furthermore, we integrate a domain randomization-based pathology synthesis augmentation strategy to improve the model's generalizability to out-of-distribution (OOD) data. On internal benchmark, BrReMark improves mAP50 from 0.74% to 37.54% compared to the base model, while achieving 21.57% Clinical F1 and 45.26% diagnostic accuracy. On NOVA OOD benchmark, it also achieves competitive overall performance with a 45.7% reduction in false positives compared to the state-of-the-art, indicating reduced hallucination on rare pathologies. These findings suggest that explicit hypothesis-verification grounding is a practical path toward trustworthy open-ended brain MRI diagnosis across both in-distribution and OOD settings.

医学影像可解释性生成对抗诊断验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。