提出轻量级3D骨骼点检测网络,兼顾精度与效率
H3DE-Net: Efficient and Accurate 3D Landmark Detection in Medical Imaging
- 用卷积网络提取局部细节,轻量注意力建模全局关系
- 在公开CT数据集上达顶尖性能,缺失点场景下更鲁棒
- 适合医学影像分析、手术导航等需要高精度定位的场景
3D骨骼点检测是医学图像分析中的关键任务,准确识别解剖标志对后续分析至关重要。然而,主流深度学习方法难以同时捕捉精细局部特征并建模复杂的全局空间关系,且难以平衡精度与计算效率。3D体数据维度高,骨骼点稀疏分布,进一步加剧了计算负担。本文提出H3DE-Net,一种融合卷积网络与轻量级注意力机制的新框架,通过分层路由策略降低计算开销,同时保持全局上下文建模能力。该机制首次将此类轻量注意力与CNN结合用于3D骨骼点检测。多尺度特征融合进一步提升精度与鲁棒性。在公开CT数据集上的实验表明,H3DE-Net达到当前最优性能,尤其在缺失点或复杂解剖变异情况下表现优异。项目已开源,包含代码、数据与模型权重。
原文摘要 · Abstract (English)
3D landmark detection is a critical task in medical image analysis, and accurately detecting anatomical landmarks is essential for subsequent medical imaging tasks. However, mainstream deep learning methods in this field struggle to simultaneously capture fine-grained local features and model global spatial relationships, while maintaining a balance between accuracy and computational efficiency. Local feature extraction requires capturing fine-grained anatomical details, while global modeling requires understanding the spatial relationships within complex anatomical structures. The high-dimensional nature of 3D volume further exacerbates these challenges, as landmarks are sparsely distributed, leading to significant computational costs. Therefore, achieving efficient and precise 3D landmark detection remains a pressing challenge in medical image analysis. In this work, We propose a \textbf{H}ybrid \textbf{3}D \textbf{DE}tection \textbf{Net}(H3DE-Net), a novel framework that combines CNNs for local feature extraction with a lightweight attention mechanism designed to efficiently capture global dependencies in 3D volumetric data. This mechanism employs a hierarchical routing strategy to reduce computational cost while maintaining global context modeling. To our knowledge, H3DE-Net is the first 3D landmark detection model that integrates such a lightweight attention mechanism with CNNs. Additionally, integrating multi-scale feature fusion further enhances detection accuracy and robustness. Experimental results on a public CT dataset demonstrate that H3DE-Net achieves state-of-the-art(SOTA) performance, significantly improving accuracy and robustness, particularly in scenarios with missing landmarks or complex anatomical variations. We aready open-source our project, including code, data and model weights.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。