提出可自适应尺度的脊柱分割网络,提升超声影像中脊柱结构识别精度。
SA$^{2}$Net: Scale-Adaptive Structure-Affinity Transformation for Spine Segmentation from Ultrasound Volume Projection Imaging
- 设计尺度自适应互补策略,捕捉脊柱图像跨维度长距离相关特征。
- 引入结构-亲和变换,融合类别特异性亲和关系提升分割准确性。
- 适配多种骨干网络,适合临床智能脊柱疾病诊断场景。
基于超声体积投影成像(VPI)的脊柱分割在智能脊柱侧弯诊断中至关重要,但面临两大挑战:忽略不同骨结构间高空间相关性导致全局上下文知识学习不足;脊柱骨骼包含丰富形状与位置结构信息,需有效编码至分割过程。为此,提出新型尺度自适应结构感知网络(SA²Net)。首先,设计尺度自适应互补策略,学习脊柱图像的跨维度长距离相关特征;其次,受Transformer多头自注意力与语义层级亲和性一致性的启发,提出结构-亲和变换,将类别特异性亲和性嵌入语义特征,并结合Transformer解码器实现结构感知推理;此外,采用特征混合损失聚合方法增强模型训练鲁棒性与精度。实验表明,SA²Net在多个指标上优于现有先进方法,且对多种骨干网络具有良好的适配性,展现出作为智能脊柱影像分析核心工具的巨大潜力。代码与演示见 https://github.com/taetiseo09/SA2Net。
原文摘要 · Abstract (English)
Spine segmentation, based on ultrasound volume projection imaging (VPI), plays a vital role for intelligent scoliosis diagnosis in clinical applications. However, this task faces several significant challenges. Firstly, the global contextual knowledge of spines may not be well-learned if we neglect the high spatial correlation of different bone features. Secondly, the spine bones contain rich structural knowledge regarding their shapes and positions, which deserves to be encoded into the segmentation process. To address these challenges, we propose a novel scale-adaptive structure-aware network (SA$^{2}$Net) for effective spine segmentation. First, we propose a scale-adaptive complementary strategy to learn the cross-dimensional long-distance correlation features for spinal images. Second, motivated by the consistency between multi-head self-attention in Transformers and semantic level affinity, we propose structure-affinity transformation to transform semantic features with class-specific affinity and combine it with a Transformer decoder for structure-aware reasoning. In addition, we adopt a feature mixing loss aggregation method to enhance model training. This method improves the robustness and accuracy of the segmentation process. The experimental results demonstrate that our SA$^{2}$Net achieves superior segmentation performance compared to other state-of-the-art methods. Moreover, the adaptability of SA$^{2}$Net to various backbones enhances its potential as a promising tool for advanced scoliosis diagnosis using intelligent spinal image analysis. The code and experimental demo are available at https://github.com/taetiseo09/SA2Net.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。