arXiv:2504.03108cs.CVcs.AI2025-04

轻量级模型高效分割皮肤病变,兼顾边界精度与计算效率。

Multi-Granularity Vision Fastformer with Fusion Mechanism for Skin Lesion Segmentation

  • 用快速注意力机制融合多粒度特征,降低计算开销。
  • 在三个数据集上参数量减少101倍、计算量减少15倍,性能更优。
  • 适合需要高精度且资源受限的皮肤病变自动分割场景。

背景:卷积神经网络(CNN)和视觉变压器(ViT)是医学图像分割的主要技术。但CNN受限于局部上下文信息,而ViT的二次复杂度带来巨大计算成本。同时,区分不同严重程度病变边界的挑战仍存在。目的:优化计算成本与长程依赖建模的平衡,并实现对不同严重程度病变的优异泛化能力。方法:提出一种轻量级U型网络VFFM-UNet,采用带有融合机制的快速视觉变压器(VFFM)。继承Fastformer的加性注意力机制,结合逐元素乘积与矩阵乘积以实现全面特征提取,并通过通道压缩降低计算成本。为精准识别不同严重程度的病变边界,设计了包含多粒度融合与通道融合的融合机制,从粒度与通道层面处理特征图,获取多样化上下文信息。结果:在ISIC2017、ISIC2018和PH2数据集上的综合实验表明,相比现有最优模型,VFFM-UNet在参数量、计算复杂度和分割性能上均表现更佳。相较于MISSFormer,本模型参数量减少101倍、计算量减少15倍,同时取得更优分割效果。结论:定量与定性分析均显示,VFFM-UNet在参数量、计算复杂度与分割性能之间达到理想平衡,树立新基准。

原文摘要 · Abstract (English)

Background:Convolutional Neural Networks(CNN) and Vision Transformers(ViT) are the main techniques used in Medical image segmentation. However, CNN is limited to local contextual information, and ViT's quadratic complexity results in significant computational costs. At the same time, equipping the model to distinguish lesion boundaries with varying degrees of severity is also a challenge encountered in skin lesion segmentation. Purpose:This research aims to optimize the balance between computational costs and long-range dependency modelling and achieve excellent generalization across lesions with different degrees of severity. Methods:we propose a lightweight U-shape network that utilizes Vision Fastformer with Fusion Mechanism (VFFM-UNet). We inherit the advantages of Fastformer's additive attention mechanism, combining element-wise product and matrix product for comprehensive feature extraction and channel reduction to save computational costs. In order to accurately identify the lesion boundaries with varying degrees of severity, we designed Fusion Mechanism including Multi-Granularity Fusion and Channel Fusion, which can process the feature maps in the granularity and channel levels to obtain different contextual information. Results:Comprehensive experiments on the ISIC2017, ISIC2018 and PH2 datasets demonstrate that VFFM-UNet outperforms existing state-of-the-art models regarding parameter numbers, computational complexity and segmentation performance. In short, compared to MISSFormer, our model achieves superior segmentation performance while reducing parameter and computation costs by 101x and 15x, respectively. Conclusions:Both quantitative and qualitative analyses show that VFFM-UNet sets a new benchmark by reaching an ideal balance between parameter numbers, computational complexity, and segmentation performance compared to existing state-of-the-art models.

皮肤病变图像分割轻量模型注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。