让分割结果尊重物体形状,生成多套合理分割方案。
Probabilistic U-Net with Kendall Shape Spaces for Geometry-Aware Segmentations of Images
- 在概率分割网络中引入肯德尔形状空间,编码几何结构先验
- 生成多个符合物体真实形状的分割结果,区域更连贯一致
- 适合需要高可靠性、形状敏感的医学图像分割任务
图像分割是计算机视觉中的基础问题,旨在识别图像中不同的区域或物体。深度神经网络(DNN)在处理复杂图像时表现出色,能生成高质量分割结果。然而,仍需具备不确定性建模能力的概率化DNN,以反映输入图像和模型本身的不确定性,即生成多个可能的分割结果及其分布。现有概率分割模型大多忽视了分割区域背后的几何结构。本文提出一种融合几何信息的概率图像分割模型,基于Probabilistic U-Net构建,可为单张输入图像生成多个合理的分割方案。该模型采用肯德尔形状变分自编码器(Kendall Shape Variational Auto-Encoder)在先验与后验网络的潜在变量层中编码肯德尔形状空间,从而增强分割的空间一致性,使结果更贴合输入图像中物体的真实几何特征。
原文摘要 · Abstract (English)
One of the fundamental problems in computer vision is image segmentation, the task of detecting distinct regions or objects in given images. Deep Neural Networks (DNN) have been shown to be very effective in segmenting challenging images, producing convincing segmentations. There is further need for probabilistic DNNs that can reflect the uncertainties from the input images and the models into the computed segmentations, in other words, new DNNs that can generate multiple plausible segmentations and their distributions depending on the input or the model uncertainties. While there are existing probabilistic segmentation models, many of them do not take into account the geometry or shape underlying the segmented regions. In this paper, we propose a probabilistic image segmentation model that can incorporate the geometry of a segmentation. Our proposed model builds on the Probabilistic U-Net of \cite{kohl2018probabilistic} to generate probabilistic segmentations, i.e.\! multiple likely segmentations for an input image. Our model also adopts the Kendall Shape Variational Auto-Encoder of \cite{vadgama2023kendall} to encode a Kendall shape space in the latent variable layers of the prior and posterior networks of the Probabilistic U-Net. Incorporating the shape space in this manner leads to a more robust segmentation with spatially coherent regions, respecting the underlying geometry in the input images.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。