用查询图像自身信息提升3D少样本分割精度
Improving 3D Few-Shot Segmentation with Inference-Time Pseudo-Labeling
- 推理时将查询图像当作无标签数据生成伪标签
- 通过置信度筛选,把关键区域信息回传给支持集
- 适用于医学影像中样本稀缺的3D分割任务
近年来,少样本分割(FSS)模型在医学影像分析中展现出良好适应性,可在仅有少量标注数据的情况下分割新类别。现有方法常忽视查询样本本身蕴含的信息,而将其视为无标签数据可显著提升预测精度。尤其在医学影像中,查询样本的三维结构提供了丰富信息,可用于优化目标切片的分割。本文提出一种新颖策略,在推理阶段充分利用查询样本的内在信息:首先利用参考体积的支持切片,通过原型方法生成查询切片的初始分割分数;随后采用置信度感知的伪标签机制,将查询切片中最可靠的区域信息传递至支持集;最终基于扩展后的新支持集进行预测,生成更精确的分割掩码。大量实验表明,该方法在多种设置和数据集上均能有效提升性能。
原文摘要 · Abstract (English)
In recent years, few-shot segmentation (FSS) models have emerged as a promising approach in medical imaging analysis, offering remarkable adaptability to segment novel classes with limited annotated data. Existing approaches to few-shot segmentation have often overlooked the potential of the query itself, failing to fully utilize the valuable information it contains. However, treating the query as unlabeled data provides an opportunity to enhance prediction accuracy. Specifically in the domain of medical imaging, the volumetric structure of queries offers a considerable source of valuable information that can be used to improve the target slice segmentation. In this work, we present a novel strategy to efficiently leverage the intrinsic information of the query sample for final segmentation during inference. First, we use the support slices from a reference volume to generate an initial segmentation score for the query slices through a prototypical approach. Subsequently, we apply a confidence-aware pseudo-labeling procedure to transfer the most informative parts of query slices to the support set. The final prediction is performed based on the new expanded support set, enabling the prediction of a more accurate segmentation mask for the query volume. Extensive experiments show that the proposed method can effectively boost performance across diverse settings and datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。