arXiv:2412.20924cs.CVcs.AI2024-12中稿 · IEEE Transactions …被引 12

用图像合成与一致性正则化,提升病理图像弱监督分割精度

HisynSeg: Weakly-Supervised Histopathological Image Segmentation via Image-Mixing Synthesis and Consistency Regularization

  • 通过拼接合成和贝塞尔掩码生成真实病理图像及标签
  • 在三个数据集上实现当前最优分割性能,显著减少误激活问题
  • 适合缺乏像素级标注的病理图像分割研究者使用

组织语义分割是计算病理学中的关键任务。为避免昂贵且耗时的像素级标注,众多研究采用类激活图(CAM)这一弱监督学习方案实现像素级组织分割。然而,基于CAM的方法易出现激活不足和过度激活问题,导致分割效果差。为此,本文提出一种基于图像混合合成与一致性正则化的新型弱监督语义分割框架——HisynSeg。具体地,利用马赛克变换和贝塞尔掩码生成策略,合成带像素级掩码的病理图像,用于全监督模型训练;同时设计图像过滤模块确保合成图像的真实性。为进一步防止模型对合成伪影过拟合,提出一种新的自监督一致性正则化方法,使无标注的真实图像也能参与分割模型训练。通过集成上述技术,HisynSeg成功将弱监督分割问题转化为全监督问题,显著提升分割精度。在三个数据集上的实验结果表明,该方法达到当前最优性能。代码已开源:https://github.com/Vison307/HisynSeg。

原文摘要 · Abstract (English)

Tissue semantic segmentation is one of the key tasks in computational pathology. To avoid the expensive and laborious acquisition of pixel-level annotations, a wide range of studies attempt to adopt the class activation map (CAM), a weakly-supervised learning scheme, to achieve pixel-level tissue segmentation. However, CAM-based methods are prone to suffer from under-activation and over-activation issues, leading to poor segmentation performance. To address this problem, we propose a novel weakly-supervised semantic segmentation framework for histopathological images based on image-mixing synthesis and consistency regularization, dubbed HisynSeg. Specifically, synthesized histopathological images with pixel-level masks are generated for fully-supervised model training, where two synthesis strategies are proposed based on Mosaic transformation and Bézier mask generation. Besides, an image filtering module is developed to guarantee the authenticity of the synthesized images. In order to further avoid the model overfitting to the occasional synthesis artifacts, we additionally propose a novel self-supervised consistency regularization, which enables the real images without segmentation masks to supervise the training of the segmentation model. By integrating the proposed techniques, the HisynSeg framework successfully transforms the weakly-supervised semantic segmentation problem into a fully-supervised one, greatly improving the segmentation accuracy. Experimental results on three datasets prove that the proposed method achieves a state-of-the-art performance. Code is available at https://github.com/Vison307/HisynSeg.

病理图像弱监督图像合成分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。