arXiv:2602.07872cs.CV2026-02中稿 · Medical Imaging wi…

通过报告引导的局部定位,精准检索儿童腕部骨折影像。

WristMIR: Coarse-to-Fine Region-Aware Retrieval of Pediatric Wrist Radiographs with Radiology Report-Driven Learning

  • 利用放射科报告生成全局与局部描述,联合训练全局和局部对比编码器。
  • 两阶段检索使图像到文本召回率从0.82%提升至9.35%,骨折分类准确率达AUC 0.949。
  • 基于解剖区域重排显著提升诊断F1值,获放射科医生更高临床相关性评分。

在儿科腕部X光片中检索具有相似骨折模式的病例极具挑战,因关键征象细微、局域性强,且常被重叠解剖结构或不同成像视角遮蔽。现有进展受限于大规模、标注精细的数据集稀缺。本文提出WristMIR,一种基于区域感知的儿科腕部影像检索框架,利用密集放射科报告与骨特异性定位,无需人工图像级标注即可学习细粒度、临床相关的图像表征。通过MedGemma进行结构化报告挖掘,生成全局与区域级描述,结合预处理的腕部影像及桡骨远端、尺骨远端、尺骨茎突的局部切片,联合训练全局与局部对比编码器,并执行两阶段检索:(1) 粗粒度全局匹配筛选候选检查,(2) 基于预定义解剖区域的条件重排序。相比强视觉-语言基线,该方法将图像到文本的Recall@5从0.82%提升至9.35%。其嵌入向量在骨折分类任务中表现优异(AUROC 0.949,AUPRC 0.953)。在区域感知评估中,两阶段设计显著提升基于检索的骨折诊断效果,平均F1值由0.568升至0.753;放射科医生评价显示,检索案例的临床相关性得分从3.36提升至4.35。结果表明,解剖引导的检索可增强诊断推理,支持儿科骨骼系统影像的临床决策。源代码已公开于https://github.com/quin-med-harvard-edu/WristMIR。

原文摘要 · Abstract (English)

Retrieving wrist radiographs with analogous fracture patterns is challenging because clinically important cues are subtle, highly localized and often obscured by overlapping anatomy or variable imaging views. Progress is further limited by the scarcity of large, well-annotated datasets for case-based medical image retrieval. We introduce WristMIR, a region-aware pediatric wrist radiograph retrieval framework that leverages dense radiology reports and bone-specific localization to learn fine-grained, clinically meaningful image representations without any manual image-level annotations. Using MedGemma-based structured report mining to generate both global and region-level captions, together with pre-processed wrist images and bone-specific crops of the distal radius, distal ulna, and ulnar styloid, WristMIR jointly trains global and local contrastive encoders and performs a two-stage retrieval process: (1) coarse global matching to identify candidate exams, followed by (2) region-conditioned reranking aligned to a predefined anatomical bone region. WristMIR improves retrieval performance over strong vision-language baselines, raising image-to-text Recall@5 from 0.82% to 9.35%. Its embeddings also yield stronger fracture classification (AUROC 0.949, AUPRC 0.953). In region-aware evaluation, the two-stage design markedly improves retrieval-based fracture diagnosis, increasing mean $F_1$ from 0.568 to 0.753, and radiologists rate its retrieved cases as more clinically relevant, with mean scores rising from 3.36 to 4.35. These findings highlight the potential of anatomically guided retrieval to enhance diagnostic reasoning and support clinical decision-making in pediatric musculoskeletal imaging. The source code is publicly available at https://github.com/quin-med-harvard-edu/WristMIR.

医学影像检索多模态学习儿童骨折

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。