轻量级Transformer模型,专为移动端医学图像分割优化
Mobile U-ViT: Revisiting large kernel and U-shaped ViT for efficient medical image segmentation
- 用大卷积核CNN+倒置瓶颈融合做分层嵌入,兼顾效率与表征能力
- 在8个2D/3D数据集上达顶尖性能,4个未见数据集零样本测试也有效
- 适合移动设备部署,尤其适用于资源受限的临床实时诊断场景
临床实践中,医学图像分析常需在资源受限的移动设备上高效运行。然而,现有移动端模型主要针对自然图像优化,在医学任务上表现不佳,因自然与医学图像存在显著信息密度差异。如何在保持计算效率的同时融入医学图像特有优势,仍是构建轻量、通用、高性能网络的挑战。为此,我们提出面向医学图像分割的移动端模型Mobile U-ViT。具体地,采用新提出的ConvUtr作为分层嵌入模块,结合参数高效的大型卷积核CNN与倒置瓶颈融合,兼具类Transformer的表征能力且更轻更快。为实现高效局部-全局信息交换,设计新型大核局部-全局-局部(LGL)块,有效平衡医学图像低信息密度与高层语义差异。最后,引入浅层轻量变压器瓶颈进行长程建模,并采用级联解码器与下采样跳跃连接实现密集预测。尽管计算需求降低,该医学优化架构在八个涵盖多种成像模态的公开2D/3D数据集上均达当前最优性能,包括在四个未见数据集上的零样本测试。结果表明其是移动端医学图像分析中高效、强大且具备泛化能力的解决方案。代码已开源:https://github.com/FengheTan9/Mobile-U-ViT。
原文摘要 · Abstract (English)
In clinical practice, medical image analysis often requires efficient execution on resource-constrained mobile devices. However, existing mobile models-primarily optimized for natural images-tend to perform poorly on medical tasks due to the significant information density gap between natural and medical domains. Combining computational efficiency with medical imaging-specific architectural advantages remains a challenge when developing lightweight, universal, and high-performing networks. To address this, we propose a mobile model called Mobile U-shaped Vision Transformer (Mobile U-ViT) tailored for medical image segmentation. Specifically, we employ the newly purposed ConvUtr as a hierarchical patch embedding, featuring a parameter-efficient large-kernel CNN with inverted bottleneck fusion. This design exhibits transformer-like representation learning capacity while being lighter and faster. To enable efficient local-global information exchange, we introduce a novel Large-kernel Local-Global-Local (LGL) block that effectively balances the low information density and high-level semantic discrepancy of medical images. Finally, we incorporate a shallow and lightweight transformer bottleneck for long-range modeling and employ a cascaded decoder with downsample skip connections for dense prediction. Despite its reduced computational demands, our medical-optimized architecture achieves state-of-the-art performance across eight public 2D and 3D datasets covering diverse imaging modalities, including zero-shot testing on four unseen datasets. These results establish it as an efficient yet powerful and generalization solution for mobile medical image analysis. Code is available at https://github.com/FengheTan9/Mobile-U-ViT.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。