用稀疏正类标注实现多类图像分割,无需背景标签且可检测异常像素。
OOD-SEG: Exploiting out-of-distribution detection techniques for learning image segmentation from sparse multi-class positive-only annotations
- 基于正类无标签学习框架,仅需稀疏正类标注,无需背景注释。
- 在多类高光谱与手术图像数据集上达到媲美全监督模型的分割精度。
- 首次将异常检测技术引入像素级分割,适合标注成本高的医疗图像场景。
尽管深度神经网络在医学和手术影像分割中取得显著进展,但仍面临两大挑战:一是获取完整像素级标注耗时且需专业领域知识;二是典型分割流程无法识别分布外(OOD)像素,部署时易产生错误输出。本文提出一种新型分割方法,属于正类-未标注(PU)学习范式,利用异常检测技术。该框架仅依赖多类稀疏正类标注,不使用任何背景类标注,将未标注像素视为潜在的正类或分布外样本。据我们所知,这是首个将多类稀疏正类标注问题形式化为像素级PU学习并结合异常检测解决的工作。未标注像素与未知类别共同构成分布外集合,可融合任意面向分类任务设计的异常检测方法。针对医学图像缺乏标准异常检测数据集和评估指标的问题,提出以保留类作为异常类的交叉验证策略。在多类高光谱与RGB手术图像数据集上的大量实验表明,该框架具备强鲁棒性与良好泛化能力。
原文摘要 · Abstract (English)
Despite significant advancements, segmentation based on deep neural networks in medical and surgical imaging faces several challenges, two of which we aim to address in this work. First, acquiring complete pixel-level segmentation labels for medical images is time-consuming and requires domain expertise. Second, typical segmentation pipelines cannot detect out-of-distribution (OOD) pixels, leaving them prone to spurious outputs during deployment. In this work, we propose a novel segmentation approach which broadly falls within the positive-unlabelled (PU) learning paradigm and exploits tools from OOD detection techniques. Our framework learns only from sparsely annotated pixels from multiple positive-only classes and does not use any annotation for the background class. These multi-class positive annotations naturally fall within the in-distribution (ID) set. Unlabelled pixels may contain positive classes but also negative ones, including what is typically referred to as \emph{background} in standard segmentation formulations. To the best of our knowledge, this work is the first to formulate multi-class segmentation with sparse positive-only annotations as a pixel-wise PU learning problem and to address it using OOD detection techniques. Here, we forgo the need for background annotation and consider these together with any other unseen classes as part of the OOD set. Our framework can integrate, at a pixel-level, any OOD detection approaches designed for classification tasks. To address the lack of existing OOD datasets and established evaluation metric for medical image segmentation, we propose a cross-validation strategy that treats held-out labelled classes as OOD. Extensive experiments on both multi-class hyperspectral and RGB surgical imaging datasets demonstrate the robustness and generalisation capability of our proposed framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。