arXiv:2503.09370cs.CVcs.AI2025-03被引 10

通过融合层次特征与对比哈希,提升医疗图像检索的准确性与安全性。

Revisiting Medical Image Retrieval via Knowledge Consolidation

  • 引入深度感知融合与结构化对比哈希,生成更鲁棒的哈希码。
  • 在解剖放射数据集上平均精度提升5.6%-38.9%,显著优于现有方法。
  • 有效识别分布外样本,适合医疗AI系统中的安全检索场景。

随着人工智能与数字医疗日益融入医疗体系,健全的治理框架对确保其伦理、安全和高效实施至关重要。在此背景下,医疗图像检索成为临床数据管理的关键环节,在辅助决策与保护患者信息方面发挥重要作用。现有方法通常基于瓶颈特征学习哈希函数,难以从混合嵌入中生成代表性哈希码。尽管对比哈希表现优异,但当前方法常将图像检索视为分类任务,使用类别标签构建正负样本对。此外,许多方法未能解决模型遭遇外部分布外(OOD)查询或对抗攻击时的泛化问题。本文提出一种新型知识整合方法,通过深度感知表示融合(DaRF)与结构化对比哈希(SCH)实现层级特征与优化函数的知识凝聚。DaRF自适应融合浅层与深层表示生成混合特征,SCH引入图像指纹增强正负样本配对的适应性。这些混合特征进一步支持分布外检测与内容推荐,助力构建安全的AI驱动医疗环境。同时,我们设计了内容引导排序机制,提升检索结果的鲁棒性与可复现性。综合评估表明,所提方法能有效识别分布外样本,并在医疗图像检索中显著优于现有方法(p<0.05)。尤其在解剖放射数据集上,平均精度提升达5.6%-38.9%。

原文摘要 · Abstract (English)

As artificial intelligence and digital medicine increasingly permeate healthcare systems, robust governance frameworks are essential to ensure ethical, secure, and effective implementation. In this context, medical image retrieval becomes a critical component of clinical data management, playing a vital role in decision-making and safeguarding patient information. Existing methods usually learn hash functions using bottleneck features, which fail to produce representative hash codes from blended embeddings. Although contrastive hashing has shown superior performance, current approaches often treat image retrieval as a classification task, using category labels to create positive/negative pairs. Moreover, many methods fail to address the out-of-distribution (OOD) issue when models encounter external OOD queries or adversarial attacks. In this work, we propose a novel method to consolidate knowledge of hierarchical features and optimisation functions. We formulate the knowledge consolidation by introducing Depth-aware Representation Fusion (DaRF) and Structure-aware Contrastive Hashing (SCH). DaRF adaptively integrates shallow and deep representations into blended features, and SCH incorporates image fingerprints to enhance the adaptability of positive/negative pairings. These blended features further facilitate OOD detection and content-based recommendation, contributing to a secure AI-driven healthcare environment. Moreover, we present a content-guided ranking to improve the robustness and reproducibility of retrieval results. Our comprehensive assessments demonstrate that the proposed method could effectively recognise OOD samples and significantly outperform existing approaches in medical image retrieval (p<0.05). In particular, our method achieves a 5.6-38.9% improvement in mean Average Precision on the anatomical radiology dataset.

医疗图像哈希检索OOD检测知识融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。