轻量级3D医学图像分割模型,兼顾精度与效率。
RefineFormer3D: Efficient 3D Medical Image Segmentation via Adaptive Multi-Scale Transformer with Cross Attention Fusion
- 用低冗余卷积和参数高效模块构建轻量架构
- 在ACDC和BraTS上达93.44%和85.9%的分割准确率
- 仅294万参数,推理快、内存小,适合临床部署
精确且计算高效的3D医学图像分割仍是临床应用中的关键挑战。基于Transformer的架构虽具优秀全局建模能力,但参数量与内存消耗过大,限制其临床落地。本文提出RefineFormer3D,一种轻量级分层Transformer架构,平衡分割精度与计算效率。该架构包含三部分:(i) 基于GhostConv3D的补丁嵌入,实现高效特征提取且冗余极少;(ii) 采用低秩投影与深度卷积的MixFFN3D模块,提升参数效率;(iii) 跨注意力融合解码器,实现自适应多尺度跳跃连接集成。RefineFormer3D仅含294万参数,远低于同类方法。在ACDC与BraTS基准测试中,平均Dice得分分别达到93.44%与85.9%,性能优于或媲美当前最优方法,同时显著降低参数量。此外,模型在GPU上单体积推理仅需8.35毫秒,内存占用低,适用于资源受限的临床环境。结果表明,RefineFormer3D是实用化3D医学图像分割的有效且可扩展方案。
原文摘要 · Abstract (English)
Accurate and computationally efficient 3D medical image segmentation remains a critical challenge in clinical workflows. Transformer-based architectures often demonstrate superior global contextual modeling but at the expense of excessive parameter counts and memory demands, restricting their clinical deployment. We propose RefineFormer3D, a lightweight hierarchical transformer architecture that balances segmentation accuracy and computational efficiency for volumetric medical imaging. The architecture integrates three key components: (i) GhostConv3D-based patch embedding for efficient feature extraction with minimal redundancy, (ii) MixFFN3D module with low-rank projections and depthwise convolutions for parameter-efficient feature extraction, and (iii) a cross-attention fusion decoder enabling adaptive multi-scale skip connection integration. RefineFormer3D contains only 2.94M parameters, substantially fewer than contemporary transformer-based methods. Extensive experiments on ACDC and BraTS benchmarks demonstrate that RefineFormer3D achieves 93.44\% and 85.9\% average Dice scores respectively, outperforming or matching state-of-the-art methods while requiring significantly fewer parameters. Furthermore, the model achieves fast inference (8.35 ms per volume on GPU) with low memory requirements, supporting deployment in resource-constrained clinical environments. These results establish RefineFormer3D as an effective and scalable solution for practical 3D medical image segmentation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。