arXiv:2503.07766cs.CVcs.LG2025-03被引 4

用新型模型提升3D医学影像分割效率,内存减半且性能不降。

SegResMamba: An Efficient Architecture for 3D Medical Image Segmentation

  • 基于结构化状态空间模型设计新架构,降低计算复杂度。
  • 训练内存低于现有最优模型一半,速度更快。
  • 适合资源有限但需高精度分割的医疗场景。

Transformer在深度学习中因能捕捉长距离依赖和全局上下文而成为主流,但在3D医学图像数据上面临训练时间长、内存消耗大等问题,制约其可扩展性并增加碳足迹。为此,我们提出一种高效3D医学图像分割模型SegResMamba,旨在降低计算复杂度、内存占用、训练时间和环境影响。该模型采用结构化状态空间模型(SSMs)替代传统Transformer,使训练时内存使用不足SOTA架构的一半,同时保持相当的分割性能,显著提升了效率与可持续性。

原文摘要 · Abstract (English)

The Transformer architecture has opened a new paradigm in the domain of deep learning with its ability to model long-range dependencies and capture global context and has outpaced the traditional Convolution Neural Networks (CNNs) in many aspects. However, applying Transformer models to 3D medical image datasets presents significant challenges due to their high training time, and memory requirements, which not only hinder scalability but also contribute to elevated CO$_2$ footprint. This has led to an exploration of alternative models that can maintain or even improve performance while being more efficient and environmentally sustainable. Recent advancements in Structured State Space Models (SSMs) effectively address some of the inherent limitations of Transformers, particularly their high memory and computational demands. Inspired by these advancements, we propose an efficient 3D segmentation model for medical imaging called SegResMamba, designed to reduce computation complexity, memory usage, training time, and environmental impact while maintaining high performance. Our model uses less than half the memory during training compared to other state-of-the-art (SOTA) architectures, achieving comparable performance with significantly reduced resource demands.

3D分割医学影像轻量模型高效架构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。