提出首个真正以Transformer为核心的3D医学图像分割模型,突破了对卷积网络的依赖。
Primus: Enforcing Attention Usage for 3D Medical Image Segmentation
- 设计纯Transformer架构,用高分辨率令牌和改进的位置编码增强注意力机制
- 在9个公开数据集上超越现有Transformer方法,媲美甚至超过顶尖卷积模型
- 适合追求高性能3D医学图像分割的研究者与临床应用开发者
Transformer在多个领域取得显著进展,但在3D医学图像分割中影响有限,卷积网络仍主导主流基准。本文分析现有基于Transformer的分割模型,发现其过度依赖卷积模块,部分架构甚至在移除Transformer后性能不变,表明其实际作用有限。为此,我们摒弃混合架构,提出以Transformer为中心的分割模型Primus和PrimusV2。Primus利用高分辨率令牌,结合先进的位置嵌入与模块设计,充分挖掘Transformer块能力;PrimusV2进一步通过迭代补丁嵌入扩展。实验显示,Primus超越现有Transformer方法,达到nnU-Net水平;PrimusV2则超越nnU-Net,与ResEnc-L、MedNeXt等顶尖卷积模型相当,在九个公共数据集上表现优异。本工作首次实现真正的Transformer-centric模型,使Transformer在3D医学图像分割中达到最先进水平。代码已公开:https://github.com/MIC-DKFZ/nnUNet/blob/master/documentation/primus.md。
原文摘要 · Abstract (English)
Transformers have achieved remarkable success across multiple fields, yet their impact on 3D medical image segmentation remains limited with convolutional networks still dominating major benchmarks. In this work, (A) we analyze current Transformer-based segmentation models and identify critical shortcomings, particularly their over-reliance on convolutional blocks. Further, we demonstrate that in some architectures, performance is unaffected by the absence of the Transformer, thereby demonstrating their limited effectiveness. To address these challenges, we move away from hybrid architectures and (B) introduce Transformer-centric segmentation architectures, termed Primus and PrimusV2. Primus leverages high-resolution tokens, combined with advances in positional embeddings and block design, to maximally leverage its Transformer blocks, while PrimusV2 expands on this through an iterative patch embedding. Through these adaptations, Primus surpasses current Transformer-based methods and competes with a default nnU-Net while PrimusV2 exceeds it and is on par with the state-of-the-art CNNs such as ResEnc-L and MedNeXt architectures across nine public datasets. In doing so, we introduce the first competitive Transformer-centric model, making Transformers state-of-the-art in 3D medical image segmentation. The code is available here: https://github.com/MIC-DKFZ/nnUNet/blob/master/documentation/primus.md.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。