通过惩罚邻像素优化分割拓扑,提升图像分割准确性
Towards High-Quality Image Segmentation: Improving Topology Accuracy by Penalizing Neighbor Pixels
- 引入邻像素惩罚机制,强制模型先优化邻域预测
- 13个数据集验证,显著提升连通结构保真度
- 兼容多种框架与损失函数,适合医学图像分割
标准深度学习分割模型无法保证拓扑准确性,导致连通区域数量或结构错误,影响后续定量分析可靠性。此前方法虽尝试改进,但常需专用架构、计算成本高或仅限管状结构。本文提出SCNP方法,通过惩罚像素与其最差分类邻像素的logits,迫使模型优先优化邻域预测,从而提升自身预测质量。该方法在13个覆盖不同形态与模态的数据集上验证有效,可集成于三种语义与实例分割框架,并适配多种损失函数,显著改善拓扑精度。代码见https://jmlipman.github.io/SCNP-SameClassNeighborPenalization。
原文摘要 · Abstract (English)
Standard deep learning models for image segmentation cannot guarantee topology accuracy, failing to preserve the correct number of connected components or structures. This, in turn, affects the quality of the segmentations and compromises the reliability of the subsequent quantification analyses. Previous works have proposed to enhance topology accuracy with specialized frameworks, architectures, and loss functions. However, these methods are often cumbersome to integrate into existing training pipelines, they are computationally very expensive, or they are restricted to structures with tubular morphology. We present SCNP, an efficient method that improves topology accuracy by penalizing the logits with their poorest-classified neighbor, forcing the model to improve the prediction at the pixels' neighbors before allowing it to improve the pixels themselves. We show the effectiveness of SCNP across 13 datasets, covering different structure morphologies and image modalities, and integrate it into three frameworks for semantic and instance segmentation. Additionally, we show that SCNP can be integrated into several loss functions, making them improve topology accuracy. Our code can be found at https://jmlipman.github.io/SCNP-SameClassNeighborPenalization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。