arXiv:2503.16058cs.CV2025-03被引 1

通过融合相似性与独特性,实现高精度单样本医学关键点检测

Landmarks Are Alike Yet Distinct: Harnessing Similarity and Individuality for One-Shot Medical Landmark Detection

  • 为每个关键点训练专用模型,避免多点训练中的性能权衡
  • 单关键点模型在多个数据集上显著优于联合训练方法
  • 适配器融合架构在保持高效的同时支持灵活个性化适应

关键点检测在疾病诊断、骨龄评估和治疗规划等医学影像应用中至关重要。然而,同时训练多个关键点常出现‘跷跷板现象’,即某些关键点性能提升会导致其他关键点下降。若为每个关键点单独建模,则会增加内存和计算开销。为此,我们提出新方法:基于‘关键点各不相同’的信念,采用伪标签与动态更新模板数据训练单关键点专用模型以实现高精度;同时基于‘关键点又具有共性’,引入适配器融合模型,结合共享权重与关键点特异性权重,实现参数高效共享并灵活适应个体差异。该方法显著降低资源消耗,有效缓解多关键点训练中的性能权衡问题。在公开医学图像数据集上的实验表明,单关键点模型在检测单个关键点时显著优于传统联合训练模型。尽管适配器融合模型性能略低于所有单模型组合结果,但仍优于现有最先进方法,并在资源效率上取得明显提升。

原文摘要 · Abstract (English)

Landmark detection plays a crucial role in medical imaging applications such as disease diagnosis, bone age estimation, and therapy planning. However, training models for detecting multiple landmarks simultaneously often encounters the "seesaw phenomenon", where improvements in detecting certain landmarks lead to declines in detecting others. Yet, training a separate model for each landmark increases memory usage and computational overhead. To address these challenges, we propose a novel approach based on the belief that "landmarks are distinct" by training models with pseudo-labels and template data updated continuously during the training process, where each model is dedicated to detecting a single landmark to achieve high accuracy. Furthermore, grounded on the belief that "landmarks are also alike", we introduce an adapter-based fusion model, combining shared weights with landmark-specific weights, to efficiently share model parameters while allowing flexible adaptation to individual landmarks. This approach not only significantly reduces memory and computational resource requirements but also effectively mitigates the seesaw phenomenon in multi-landmark training. Experimental results on publicly available medical image datasets demonstrate that the single-landmark models significantly outperform traditional multi-point joint training models in detecting individual landmarks. Although our adapter-based fusion model shows slightly lower performance compared to the combined results of all single-landmark models, it still surpasses the current state-of-the-art methods while achieving a notable improvement in resource efficiency.

医学图像关键点检测适配器单样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。