arXiv:2604.24347eess.IVcs.CV2026-04IJCV

用全局比例推断病理图像像素级分割,无需标注

Semantic Segmentation for Histopathology using Learned Regularization based on Global Proportions

论文配图:Semantic Segmentation for Histopathology using Learned Regularization based on Global Proportions
图 1 · 摘自论文原文
  • 两阶段框架:先用预训练模型生成置信度图,再通过变分优化融合
  • 在两个公开数据集上超越现有弱监督与无监督方法
  • 可解释性强,适合真实临床场景中标签不精确的病理分析

在病理学中,组织类型的空间分布和比例是疾病进展的关键指标,且比细粒度标注更容易获取。然而,这些信息极少被映射到像素级分割。该任务本质上是欠定的,因为缺乏像素级约束时,存在多种空间不同的分割方案满足相同的全局比例。为此,我们提出变分分割从标签比例(VSLP),一种两阶段框架,仅基于全局标签比例推断密集分割,无需任何像素级标注。第一阶段利用预训练的Transformer模型结合测试时增强,生成像素级置信度估计;第二阶段通过求解变分优化问题,融合水桶距离数据保真项与学习得到的正则化项。与端到端网络不同,我们的变分方法能可视化保真度-正则化能量,实现更高可解释性。我们在两个公开数据集上验证了该方法,性能优于现有弱监督和无监督方法。其中一个数据集的比例由经验病理学家估算,为社区提供了真实基准。此外,该方法在包含噪声病理学家标签的内部数据集上表现显著优于当前最优方法,展示了其实际应用潜力。代码与数据将在接受后公开于 https://github.com/xiaoliangpi/VSLP。

原文摘要 · Abstract (English)

In pathology, the spatial distribution and proportions of tissue types are key indicators of disease progression, and are more readily available than fine-grained annotations. However, these assessments are rarely mapped to pixel-wise segmentation. The task is fundamentally underdetermined, as many spatially distinct segmentations can satisfy the same global proportions in the absence of pixel-wise constraints. To address this, we introduce Variational Segmentation from Label Proportions (VSLP), a two-stage framework that infers dense segmentations from global label proportions, without any pixel-level annotations. This framework first leverages a pre-trained transformer model with test-time augmentation to produce a pixel-wise confidence estimate. In the second stage, these estimates are fused by solving a variational optimization problem that incorporates a Wasserstein data fidelity term alongside a learned regularizer. Unlike end-to-end networks, our variational method can visualize the fidelity-regularization energy, resulting in more interpretable segmentation. We validate our approach on two public datasets, achieving superior performance over existing weakly supervised and unsupervised methods. For one of these datasets, proportions have been estimated by an experienced pathologist to provide a realistic benchmark to the community. Furthermore, the method scales to an in-house dataset with noisy pathologist labels, severely outperforming state-of-the-art methods, thereby demonstrating practical applicability. The code and data will be made publicly available upon acceptance at https://github.com/xiaoliangpi/VSLP.

病理分割弱监督变分方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。