提出多阶段融合网络,提升皮肤病变分割的准确性和泛化能力。
Hyper-Fusion Network for Semi-Automatic Segmentation of Skin Lesions
- 设计多阶段融合机制,分层迭代使用用户输入优化分割结果。
- 在ISIC 2017、2016和PH2数据集上均超越现有最优方法。
- 特别适合边界模糊、纹理不均的复杂病变分割任务。
基于全卷积网络(FCN)的自动皮肤病变分割方法在精度上处于领先地位。然而,当训练数据不足以覆盖病变的各种形态变化时,尤其在不同患者间病变大小、形状、纹理差异显著的情况下,这些方法难以分割出训练集中少见特征的病变。为此,结合用户输入与高阶语义特征的半自动分割方法成为有效补充。现有方法多采用早期融合策略,仅在前几层卷积中融合图像特征与用户输入,导致用户信息在后续层中丢失,限制了对复杂病变的引导作用。本文提出超融合网络(HFN),在多个阶段实现用户输入与图像特征的分层融合,通过分离提取互补特征,使用户输入可在各融合阶段持续迭代优化分割结果。在ISIC 2017、ISIC 2016和PH2数据集上的实验表明,该方法在准确性与泛化性方面均优于当前最优方法。
原文摘要 · Abstract (English)
Automatic skin lesion segmentation methods based on fully convolutional networks (FCNs) are regarded as the state-of-the-art for accuracy. When there are, however, insufficient training data to cover all the variations in skin lesions, where lesions from different patients may have major differences in size/shape/texture, these methods failed to segment the lesions that have image characteristics, which are less common in the training datasets. FCN-based semi-automatic segmentation methods, which fuse user-inputs with high-level semantic image features derived from FCNs offer an ideal complement to overcome limitations of automatic segmentation methods. These semi-automatic methods rely on the automated state-of-the-art FCNs coupled with user-inputs for refinements, and therefore being able to tackle challenging skin lesions. However, there are a limited number of FCN-based semi-automatic segmentation methods and all these methods focused on early-fusion, where the first few convolutional layers are used to fuse image features and user-inputs and then derive fused image features for segmentation. For early-fusion based methods, because the user-input information can be lost after the first few convolutional layers, consequently, the user-input information will have limited guidance and constraint in segmenting the challenging skin lesions with inhomogeneous textures and fuzzy boundaries. Hence, in this work, we introduce a hyper-fusion network (HFN) to fuse the extracted user-inputs and image features over multiple stages. We separately extract complementary features which then allows for an iterative use of user-inputs along all the fusion stages to refine the segmentation. We evaluated our HFN on ISIC 2017, ISIC 2016 and PH2 datasets, and our results show that the HFN is more accurate and generalizable than the state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。