提出分层专家路由框架,实现医学影像的全局与局部精准检索
HMAR: Hierarchical Modality-Aware Expert and Dynamic Routing Medical Image Retrieval Architecture
- 采用双专家机制,分别处理全局与局部特征,支持细粒度区域检索
- 在CT数据集上达到0.724的mAP(128位哈希码),优于当前最佳方法1.1%
- 无需标注框即可训练,适合临床场景中对病灶区域的高效检索
医学图像检索(MIR)是辅助诊断的关键环节,但现有系统存在三大缺陷:统一特征编码忽略解剖结构的临床重要性差异,基于粗略分类标签的相似性度量模糊,且仅关注全局图像相似性,难以满足临床对细粒度区域检索的需求。本文提出HMAR(分层模态感知专家与动态路由架构),基于混合专家(MoE)结构构建自适应检索框架。该框架采用双专家机制:Expert0提取全局特征用于整体匹配,Expert1学习位置无关的局部表示以实现病灶区域精确检索。通过两阶段对比学习策略,避免昂贵的边界框标注需求;滑动窗口匹配算法在推理时实现密集局部比对。利用柯尔莫哥洛夫-阿诺德网络(KAN)层生成哈希码,支持高效的汉明距离搜索。在RadioImageNet-CT数据集(16类临床模式,29,903张图像)上的实验表明,HMAR在64位和128位哈希码下分别取得0.711和0.724的均值平均精度(mAP),较当前最优方法ACIR分别提升0.7%和1.1%。
原文摘要 · Abstract (English)
Medical image retrieval (MIR) is a critical component of computer-aided diagnosis, yet existing systems suffer from three persistent limitations: uniform feature encoding that fails to account for the varying clinical importance of anatomical structures, ambiguous similarity metrics based on coarse classification labels, and an exclusive focus on global image similarity that cannot meet the clinical demand for fine-grained region-specific retrieval. We propose HMAR (Hierarchical Modality-Aware Expert and Dynamic Routing), an adaptive retrieval framework built on a Mixture-of-Experts (MoE) architecture. HMAR employs a dual-expert mechanism: Expert0 extracts global features for holistic similarity matching, while Expert1 learns position-invariant local representations for precise lesion-region retrieval. A two-stage contrastive learning strategy eliminates the need for expensive bounding-box annotations, and a sliding-window matching algorithm enables dense local comparison at inference time. Hash codes are generated via Kolmogorov-Arnold Network (KAN) layers for efficient Hamming-distance search. Experiments on the RadioImageNet-CT dataset (16 clinical patterns, 29,903 images) show that HMAR achieves mean Average Precision (mAP) of 0.711 and 0.724 for 64-bit and 128-bit hash codes, improving over the state-of-the-art ACIR method by 0.7% and 1.1%, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。