提出轮廓流约束,提升图像分割的全局形状一致性。
Contour Flow Constraint: Preserving Global Shape Similarity for Deep Learning based Image Segmentation
- 基于轮廓相似性构建全局形状一致性约束
- 在多个基准模型上提升分割精度与形状相似性
- 适用于抗噪场景,适合需要精确形状输出的任务
为实现高效图像分割,需引入关于待分割区域特征的先验约束以获得良好分割结果。现有方法多关注特定属性或形状先验,缺乏从轮廓流(CF)视角对全局形状相似性的考虑。此外,如何将该轮廓流先验通过数学方法自然融入深度卷积网络的激活函数尚无探索。本文提出基于轮廓相似性的全局形状相似性概念,并数学推导出保持该相似性的轮廓流约束。提出两种集成方式:其一,将约束转化为形状损失,可无缝嵌入任意学习型分割框架的训练阶段;其二,将其加入变分分割模型并推导迭代求解方案,再通过展开得到所提CFSSnet架构。在多个数据集上的验证实验表明,所提形状损失显著提升分割准确率与形状相似性,且对不同网络架构具有广泛适应性。CFSSnet在噪声污染图像下表现稳健,具备天然的全局形状保持能力。
原文摘要 · Abstract (English)
For effective image segmentation, it is crucial to employ constraints informed by prior knowledge about the characteristics of the areas to be segmented to yield favorable segmentation outcomes. However, the existing methods have primarily focused on priors of specific properties or shapes, lacking consideration of the general global shape similarity from a Contour Flow (CF) perspective. Furthermore, naturally integrating this contour flow prior image segmentation model into the activation functions of deep convolutional networks through mathematical methods is currently unexplored. In this paper, we establish a concept of global shape similarity based on the premise that two shapes exhibit comparable contours. Furthermore, we mathematically derive a contour flow constraint that ensures the preservation of global shape similarity. We propose two implementations to integrate the constraint with deep neural networks. Firstly, the constraint is converted to a shape loss, which can be seamlessly incorporated into the training phase for any learning-based segmentation framework. Secondly, we add the constraint into a variational segmentation model and derive its iterative schemes for solution. The scheme is then unrolled to get the architecture of the proposed CFSSnet. Validation experiments on diverse datasets are conducted on classic benchmark deep network segmentation models. The results indicate a great improvement in segmentation accuracy and shape similarity for the proposed shape loss, showcasing the general adaptability of the proposed loss term regardless of specific network architectures. CFSSnet shows robustness in segmenting noise-contaminated images, and inherent capability to preserve global shape similarity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。