提出LamFormer网络,兼顾多器官分割的精度与计算效率。
An Enhanced Pyramid Feature Network Based on Long-Range Dependencies for Multi-Organ Medical Image Segmentation
- 用线性注意力Mamba构建增强金字塔编码器,捕捉多尺度长程依赖
- 在7个数据集上优于现有方法,平均Dice达90.2%以上
- 适合需要高精度且资源受限的医学图像分割场景
在多器官医学图像分割领域,现有方法常采用Transformer捕捉图像特征中的长程依赖,但存在计算成本高、局部细节信息提取不足的问题。为解决上述问题,本文重新设计特征提取模块,提出名为LamFormer的新深度学习网络,用于多器官精细分割任务。LamFormer是一种U型网络,其增强金字塔编码器采用线性注意力Mamba(LAM)来捕获多尺度长程依赖。设计并行分层特征聚合(PHFA)模块,融合编码器不同层级特征,缩小语义差异并过滤冗余信息。最后引入简化变压器(RT),以独特计算方式全局建模上采样特征,增强局部细节提取能力,提升长程依赖捕捉性能。LamFormer在七个复杂多样的数据集上超越现有分割方法,表现优异。同时,该网络在模型性能与复杂度之间取得良好平衡。
原文摘要 · Abstract (English)
In the field of multi-organ medical image segmentation, recent methods frequently employ Transformers to capture long-range dependencies from image features. However, these methods overlook the high computational cost of Transformers and their deficiencies in extracting local detailed information. To address high computational costs and inadequate local detail information, we reassess the design of feature extraction modules and propose a new deep-learning network called LamFormer for fine-grained segmentation tasks across multiple organs. LamFormer is a novel U-shaped network that employs Linear Attention Mamba (LAM) in an enhanced pyramid encoder to capture multi-scale long-range dependencies. We construct the Parallel Hierarchical Feature Aggregation (PHFA) module to aggregate features from different layers of the encoder, narrowing the semantic gap among features while filtering information. Finally, we design the Reduced Transformer (RT), which utilizes a distinct computational approach to globally model up-sampled features. RRT enhances the extraction of detailed local information and improves the network's capability to capture long-range dependencies. LamFormer outperforms existing segmentation methods on seven complex and diverse datasets, demonstrating exceptional performance. Moreover, the proposed network achieves a balance between model performance and model complexity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。