提出HSMix增强医学图像分割的数据多样性,兼顾轮廓与显著性信息。
HSMix: Hard and Soft Mixing Data Augmentation for Medical Image Segmentation
- 通过硬混合与软混合结合,融合双图超像素并调节亮度以生成新图像
- 在多个医学分割任务中提升性能,有效缓解数据稀缺导致的过拟合问题
- 无需复杂预训练或伪标签,可直接嵌入现有模型,适用多种影像模态
由于标注成本高或某些疾病罕见,医学图像分割常受限于数据稀缺和过拟合问题。自监督与半监督学习虽能部分缓解此问题,但需手工设计预文本或定义清晰的伪标签,过程复杂。相比之下,数据增强方法更简单直接,在图像识别中已取得显著成效。然而,局部图像编辑类增强在分割任务中的效果尚未充分探索。本文提出HSMix,一种基于硬混合与软混合的局部图像编辑数据增强方法,用于医学语义分割。首先,将两张源图像的同质区域(超像素)进行硬混合生成新图像;随后,利用局部聚合的像素级显著性系数对混合区域亮度进行软调整。两源图像的真实分割掩码同步执行相同混合操作,生成对应的新掩码。该方法充分利用了先验轮廓与显著性信息,既保留了增强图像中的局部语义,又拓展了增强空间的多样性。HSMix为即插即用方案,模型无关,适用于多种医学成像模态。大量实验证明其在多类医学分割任务中均具有效性。源代码已开源:https://github.com/DanielaPlusPlus/HSMix。
原文摘要 · Abstract (English)
Due to the high cost of annotation or the rarity of some diseases, medical image segmentation is often limited by data scarcity and the resulting overfitting problem. Self-supervised learning and semi-supervised learning can mitigate the data scarcity challenge to some extent. However, both of these paradigms are complex and require either hand-crafted pretexts or well-defined pseudo-labels. In contrast, data augmentation represents a relatively simple and straightforward approach to addressing data scarcity issues. It has led to significant improvements in image recognition tasks. However, the effectiveness of local image editing augmentation techniques in the context of segmentation has been less explored. We propose HSMix, a novel approach to local image editing data augmentation involving hard and soft mixing for medical semantic segmentation. In our approach, a hard-augmented image is created by combining homogeneous regions (superpixels) from two source images. A soft mixing method further adjusts the brightness of these composed regions with brightness mixing based on locally aggregated pixel-wise saliency coefficients. The ground-truth segmentation masks of the two source images undergo the same mixing operations to generate the associated masks for the augmented images. Our method fully exploits both the prior contour and saliency information, thus preserving local semantic information in the augmented images while enriching the augmentation space with more diversity. Our method is a plug-and-play solution that is model agnostic and applicable to a range of medical imaging modalities. Extensive experimental evidence has demonstrated its effectiveness in a variety of medical segmentation tasks. The source code is available in https://github.com/DanielaPlusPlus/HSMix.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。