arXiv:2502.05396eess.IVcs.CV2025-02被引 2

提出无需卷积的3D医学图像分割新方法,提升细结构分割精度。

A Novel Convolutional-Free Method for 3D Medical Imaging Segmentation

  • 纯注意力机制设计,摒弃卷积网络,捕捉长距离依赖关系。
  • 在薄层CT图像上实现高精度分割,优于传统与混合架构模型。
  • 构建首个薄层多语义分割基准数据集,推动领域发展。

3D医学图像分割对精准诊断和治疗规划至关重要。尽管卷积神经网络(CNN)已取得显著成果,但在捕捉长程依赖和全局上下文方面存在局限,尤其影响细微复杂结构的分割性能。近期基于Transformer的模型如TransUNet和nnFormer展现出潜力,但仍依赖混合架构。本文提出一种完全去卷积的Transformer模型,通过自注意力机制实现3D医学图像分割。该方法提升多语义分割精度,并解决厚层与薄层CT图像间的域适应问题。我们设计联合损失函数,利用厚层标注信息指导薄层图像分割,缓解数据稀缺难题。此外,首次构建了薄层多语义分割基准数据集,填补当前研究空白。实验表明,所提模型超越传统及混合架构,在多个指标上表现更优,为无卷积医学图像分割提供新思路。

原文摘要 · Abstract (English)

Segmentation of 3D medical images is a critical task for accurate diagnosis and treatment planning. Convolutional neural networks (CNNs) have dominated the field, achieving significant success in 3D medical image segmentation. However, CNNs struggle with capturing long-range dependencies and global context, limiting their performance, particularly for fine and complex structures. Recent transformer-based models, such as TransUNet and nnFormer, have demonstrated promise in addressing these limitations, though they still rely on hybrid CNN-transformer architectures. This paper introduces a novel, fully convolutional-free model based on transformer architecture and self-attention mechanisms for 3D medical image segmentation. Our approach focuses on improving multi-semantic segmentation accuracy and addressing domain adaptation challenges between thick and thin slice CT images. We propose a joint loss function that facilitates effective segmentation of thin slices based on thick slice annotations, overcoming limitations in dataset availability. Furthermore, we present a benchmark dataset for multi-semantic segmentation on thin slices, addressing a gap in current medical imaging research. Our experiments demonstrate the superiority of the proposed model over traditional and hybrid architectures, offering new insights into the future of convolution-free medical image segmentation.

3D分割Transformer医学图像注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。