轻量级网络精准分割皮肤病变,适合移动端部署。
LSSF-Net: Lightweight Segmentation with Self-Awareness, Spatial Attention, and Focal Modulation
- 融合自知空间注意力与焦点调制机制,捕捉局部细节与全局上下文。
- 仅0.8百万参数,在4个数据集上实现领先分割精度。
- 专为移动设备设计,兼顾速度与高精度,适合临床辅助诊断。
在移动设备上进行皮肤癌的计算机辅助诊断中,准确分割皮肤病变对及时识别至关重要。然而,病变形状多样、边界模糊,且常受毛发、标记色等干扰,同时病变与健康皮肤在纹理和颜色上差异细微,难以区分,需模型同时捕捉细粒度特征与整体上下文信息。现有黑素瘤分割模型多基于全连接网络或U-Net,但难以应对边界不清、表现多样的复杂特征,导致分割性能不佳。为此,我们提出一种新型轻量级网络LSSF-Net,专为移动端设计,仅含0.8百万可学习参数。该网络采用编码器-解码器结构,集成基于Conformer的焦点调制注意力、自知式局部与全局空间注意力及分组通道洗牌机制。在四个权威基准数据集ISIC 2016、ISIC 2017、ISIC 2018和PH2上的实证结果表明,该模型达到当前最优性能,尤其体现在高交并比(Jaccard index)上。
原文摘要 · Abstract (English)
Accurate segmentation of skin lesions within dermoscopic images plays a crucial role in the timely identification of skin cancer for computer-aided diagnosis on mobile platforms. However, varying shapes of the lesions, lack of defined edges, and the presence of obstructions such as hair strands and marker colors make this challenge more complex. \textcolor{red}Additionally, skin lesions often exhibit subtle variations in texture and color that are difficult to differentiate from surrounding healthy skin, necessitating models that can capture both fine-grained details and broader contextual information. Currently, melanoma segmentation models are commonly based on fully connected networks and U-Nets. However, these models often struggle with capturing the complex and varied characteristics of skin lesions, such as the presence of indistinct boundaries and diverse lesion appearances, which can lead to suboptimal segmentation performance.To address these challenges, we propose a novel lightweight network specifically designed for skin lesion segmentation utilizing mobile devices, featuring a minimal number of learnable parameters (only 0.8 million). This network comprises an encoder-decoder architecture that incorporates conformer-based focal modulation attention, self-aware local and global spatial attention, and split channel-shuffle. The efficacy of our model has been evaluated on four well-established benchmark datasets for skin lesion segmentation: ISIC 2016, ISIC 2017, ISIC 2018, and PH2. Empirical findings substantiate its state-of-the-art performance, notably reflected in a high Jaccard index.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。