arXiv:2412.06499cs.CV2024-12被引 3

提出混合注意力网络HYATT-Net,提升医学图像解剖标志点检测精度与效率

HYATT-Net is Grand: A Hybrid Attention Network for Performant Anatomical Landmark Detection

  • 融合CNN与Transformer的双路架构,用双层路由注意力聚焦关键区域
  • 在5个数据集上达到当前最佳性能,最高准确率提升2.1%,推理速度更快
  • 适合需要高精度、低延迟的临床医学图像分析场景

从医学图像中检测解剖标志点对多种临床应用至关重要。现有方法常难以兼顾全局上下文与计算效率,尤其在高分辨率图像上表现受限,由此引发一个核心问题:解剖标志点检测的性能极限在哪里?本文提出一种高性能的混合注意力网络(HYATT-Net),包含两个关键设计:(i) 创新性混合架构,整合卷积神经网络与Transformer,核心为BiFormer模块,采用双层路由注意力机制高效聚焦相关图像区域,并结合注意力残差模块(ARM),实现由全局上下文引导的精细局部特征优化;(ii) 特征融合修正模块,聚合多尺度特征以缓解分辨率损失,通过多分辨率热图上的均方误差损失进行深度监督优化模型。在五个不同数据集上的实验表明,该方法在准确性、鲁棒性和效率方面均超越现有方法,达到当前最优水平。代码与数据已公开于: https://github.com/ECNUACRush/HYATT-Net。

原文摘要 · Abstract (English)

Anatomical landmark detection (ALD) from a medical image is crucial for a wide array of clinical applications. While existing methods achieve quite some success in ALD, they often struggle to balance global context with computational efficiency, particularly with high-resolution images, thereby leading to the rise of a natural question: where is the performance limit of ALD? In this paper, we aim to forge performant ALD by proposing a {\bf HY}brid {\bf ATT}ention {\bf Net}work (HYATT-Net) with the following designs: (i) A novel hybrid architecture that integrates CNNs and Transformers. Its core is the BiFormer module, utilizing Bi-Level Routing Attention for efficient attention to relevant image regions. This, combined with Attention Residual Module(ARM), enables precise local feature refinement guided by the global context. (ii) A Feature Fusion Correction Module that aggregates multi-scale features and thus mitigates a resolution loss. Deep supervision with a mean-square error loss on multi-resolution heatmaps optimizes the model. Experiments on five diverse datasets demonstrate state-of-the-art performance, surpassing existing methods in accuracy, robustness, and efficiency. The HYATT-Net provides a promising solution for accurate and efficient ALD in complex medical images. Our codes and data are already released at: \url{https://github.com/ECNUACRush/HYATT-Net}.

医学图像标志点检测注意力机制双路网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。