用2D切片嵌入实现可解释的脑部MRI图像检索,提升准确率与可读性。
iCBIR-Sli: Interpretable Content-Based Image Retrieval with 2D Slice Embeddings
- 将3D脑MRI拆解为2D切片,融合信息生成高保真低维表示
- 在5个公开数据集上达到0.859的顶1召回率,媲美专用分类模型
- 可精确定位病变区域,适合临床辅助诊断与医学研究
当前脑部MRI搜索多依赖文本方法,亟需内容基图像检索(CBIR)系统。直接使用3D脑部MRI训练模型虽能有效学习结构,但需大量数据;而现有基于连续2D切片的方法易忽略病灶特征及深度方向不连续性。本文首次提出可解释的脑部MRI CBIR方法iCBIR-Sli(Interpretable CBIR with 2D Slice Embedding),全局利用一系列2D切片,通过有效聚合切片信息,获得具备高完整性、可用性、鲁棒性和互操作性的低维表示,满足高效CBIR需求。在五个公开脑部MRI数据集(ADNI2/3、OASIS3/4、AIBL)上进行检索评估,iCBIR-Sli在阿尔茨海默病与认知正常人群间实现顶1检索性能(宏平均F1=0.859),无需外部分类器即可达到现有深度学习分类模型水平。此外,该方法能清晰识别与目标疾病相关的脑区,提供高度可解释性。
原文摘要 · Abstract (English)
Current methods for searching brain MR images rely on text-based approaches, highlighting a significant need for content-based image retrieval (CBIR) systems. Directly applying 3D brain MR images to machine learning models offers the benefit of effectively learning the brain's structure; however, building the generalized model necessitates a large amount of training data. While models that consider depth direction and utilize continuous 2D slices have demonstrated success in segmentation and classification tasks involving 3D data, concerns remain. Specifically, using general 2D slices may lead to the oversight of pathological features and discontinuities in depth direction information. Furthermore, to the best of the authors' knowledge, there have been no attempts to develop a practical CBIR system that preserves the entire brain's structural information. In this study, we propose an interpretable CBIR method for brain MR images, named iCBIR-Sli (Interpretable CBIR with 2D Slice Embedding), which, for the first time globally, utilizes a series of 2D slices. iCBIR-Sli addresses the challenges associated with using 2D slices by effectively aggregating slice information, thereby achieving low-dimensional representations with high completeness, usability, robustness, and interoperability, which are qualities essential for effective CBIR. In retrieval evaluation experiments utilizing five publicly available brain MR datasets (ADNI2/3, OASIS3/4, AIBL) for Alzheimer's disease and cognitively normal, iCBIR-Sli demonstrated top-1 retrieval performance (macro F1 = 0.859), comparable to existing deep learning models explicitly designed for classification, without the need for an external classifier. Additionally, the method provided high interpretability by clearly identifying the brain regions indicative of the searched-for disease.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。