轻量级混合模型实现皮肤癌精准分割,参数少23倍
MobileUNETR: A Lightweight End-To-End Hybrid Vision Transformer For Efficient Medical Image Segmentation

- 用轻量混合编码器兼顾局部与全局特征提取
- 新型混合解码器多尺度融合特征,提升分割精度
- 仅300万参数,计算量降低23倍,适合移动端部署
皮肤癌分割在医学图像分析中极具挑战。现有主流方法多为基于CNN,缺乏全局上下文理解;而大型Transformer模型虽能弥补此缺陷,却带来巨大参数与计算开销。许多Transformer方法仍依赖CNN解码器,忽视了Transformer解码的优势。为此,我们提出MobileUNETR,一种轻量级端到端混合视觉变换模型,旨在克服CNN与Transformer的性能瓶颈,同时最小化模型规模。其核心有三:1)采用轻量级混合CNN-Transformer编码器,高效平衡局部与全局特征提取;2)设计新颖的混合解码器,在解码阶段多分辨率融合低层与全局特征,生成高精度掩码;3)相比复杂架构,仅需300万参数与1.3 GFLOP计算量,参数与浮点运算分别减少10倍和23倍。在ISIC 2016、ISIC 2017、ISIC 2018及PH2四个公开皮肤病变分割数据集上进行了充分实验验证。代码将公开于https://github.com/OSUPCVLab/MobileUNETR.git。
原文摘要 · Abstract (English)
Skin cancer segmentation poses a significant challenge in medical image analysis. Numerous existing solutions, predominantly CNN-based, face issues related to a lack of global contextual understanding. Alternatively, some approaches resort to large-scale Transformer models to bridge the global contextual gaps, but at the expense of model size and computational complexity. Finally many Transformer based approaches rely primarily on CNN based decoders overlooking the benefits of Transformer based decoding models. Recognizing these limitations, we address the need efficient lightweight solutions by introducing MobileUNETR, which aims to overcome the performance constraints associated with both CNNs and Transformers while minimizing model size, presenting a promising stride towards efficient image segmentation. MobileUNETR has 3 main features. 1) MobileUNETR comprises of a lightweight hybrid CNN-Transformer encoder to help balance local and global contextual feature extraction in an efficient manner; 2) A novel hybrid decoder that simultaneously utilizes low-level and global features at different resolutions within the decoding stage for accurate mask generation; 3) surpassing large and complex architectures, MobileUNETR achieves superior performance with 3 million parameters and a computational complexity of 1.3 GFLOP resulting in 10x and 23x reduction in parameters and FLOPS, respectively. Extensive experiments have been conducted to validate the effectiveness of our proposed method on four publicly available skin lesion segmentation datasets, including ISIC 2016, ISIC 2017, ISIC 2018, and PH2 datasets. The code will be publicly available at: https://github.com/OSUPCVLab/MobileUNETR.git
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。