arXiv:2507.17412cs.CVcs.AI2025-07被引 1

用3D图像检索帮医生快速找相似肿瘤病例,无需预分割数据。

Content-based 3D Image Retrieval and a ColBERT-inspired Re-ranking for Tumor Flagging and Staging

  • 提出无需预分割的3D图像检索框架,适配真实医疗影像系统。
  • 引入C-MIR方法,显著提升结肠和肺部肿瘤识别准确率(p<0.05)。
  • 适合临床影像分析、放射科医生及医学AI研发者使用。

医疗影像数量激增给放射科医生带来检索挑战。基于内容的图像检索(CBIR)系统有望高效获取相似病例,但缺乏标准化评估与全面研究。本文在肿瘤表征CBIR基础上,推进三维医学图像检索研究,提出三项关键贡献:(1)构建不依赖预分割数据与器官特异性数据集的框架,契合临床中大型非结构化影像归档系统(PACS);(2)提出C-MIR,一种将ColBERT的上下文延迟交互机制适配至三维医学影像的新型重排序方法;(3)在四个肿瘤部位上,采用三种特征提取器与三种数据库配置进行综合评估。实验表明,C-MIR显著优于传统方法,成功将延迟交互原理应用于三维医学图像,实现上下文感知重排序。关键发现包括:C-MIR能有效定位病灶区域,无需预分割,计算效率高于依赖昂贵数据增强的系统;在肿瘤标记任务中表现优异,尤其对结肠与肺部肿瘤提升显著(p<0.05);在肿瘤分期方面亦具潜力,值得进一步探索。本工作旨在弥合先进检索技术与临床应用间的差距,助力诊断流程优化。

原文摘要 · Abstract (English)

The increasing volume of medical images poses challenges for radiologists in retrieving relevant cases. Content-based image retrieval (CBIR) systems offer potential for efficient access to similar cases, yet lack standardized evaluation and comprehensive studies. Building on prior studies for tumor characterization via CBIR, this study advances CBIR research for volumetric medical images through three key contributions: (1) a framework eliminating reliance on pre-segmented data and organ-specific datasets, aligning with large and unstructured image archiving systems, i.e. PACS in clinical practice; (2) introduction of C-MIR, a novel volumetric re-ranking method adapting ColBERT's contextualized late interaction mechanism for 3D medical imaging; (3) comprehensive evaluation across four tumor sites using three feature extractors and three database configurations. Our evaluations highlight the significant advantages of C-MIR. We demonstrate the successful adaptation of the late interaction principle to volumetric medical images, enabling effective context-aware re-ranking. A key finding is C-MIR's ability to effectively localize the region of interest, eliminating the need for pre-segmentation of datasets and offering a computationally efficient alternative to systems relying on expensive data enrichment steps. C-MIR demonstrates promising improvements in tumor flagging, achieving improved performance, particularly for colon and lung tumors (p<0.05). C-MIR also shows potential for improving tumor staging, warranting further exploration of its capabilities. Ultimately, our work seeks to bridge the gap between advanced retrieval techniques and their practical applications in healthcare, paving the way for improved diagnostic processes.

图像检索肿瘤识别3D医学影像深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。