arXiv:2505.02753cs.CV2025-05CVPR被引 2

用冻结扩散模型实现跨部位肿瘤零样本分割,效果更准更泛化。

Advancing Generalizable Tumor Segmentation with Anomaly-Aware Open-Vocabulary Attention Maps and Frozen Foundation Diffusion Models

  • 基于文本提示生成异常感知的开放词汇注意力图,突破类别限制。
  • 通过隐空间修复病变区域,生成高质量伪健康图像提升分割精度。
  • 在4个数据集7类肿瘤上表现超当前最优,适合医疗影像通用分割场景。

我们探索通用肿瘤分割,旨在训练一个单一模型,在不同解剖区域实现零样本肿瘤分割。现有方法受限于分割质量、可扩展性及适用成像模态范围。本文发现冻结医学基础扩散模型内部表征具有高效零样本学习潜力,提出新框架DiffuGTS。DiffuGTS基于文本提示生成异常感知的开放词汇注意力图,实现不依赖预定义类别列表的通用异常分割。为进一步优化分割掩码,DiffuGTS利用扩散模型,通过隐空间修补将病灶区域转换为高质量伪健康图像,并采用新颖的像素级与特征级残差学习策略,显著提升分割质量和泛化能力。在四个数据集和七种肿瘤类别上的全面实验表明,该方法在多个零样本设置下超越当前最先进模型。代码已开源:https://github.com/Yankai96/DiffuGTS。

原文摘要 · Abstract (English)

We explore Generalizable Tumor Segmentation, aiming to train a single model for zero-shot tumor segmentation across diverse anatomical regions. Existing methods face limitations related to segmentation quality, scalability, and the range of applicable imaging modalities. In this paper, we uncover the potential of the internal representations within frozen medical foundation diffusion models as highly efficient zero-shot learners for tumor segmentation by introducing a novel framework named DiffuGTS. DiffuGTS creates anomaly-aware open-vocabulary attention maps based on text prompts to enable generalizable anomaly segmentation without being restricted by a predefined training category list. To further improve and refine anomaly segmentation masks, DiffuGTS leverages the diffusion model, transforming pathological regions into high-quality pseudo-healthy counterparts through latent space inpainting, and applies a novel pixel-level and feature-level residual learning approach, resulting in segmentation masks with significantly enhanced quality and generalization. Comprehensive experiments on four datasets and seven tumor categories demonstrate the superior performance of our method, surpassing current state-of-the-art models across multiple zero-shot settings. Codes are available at https://github.com/Yankai96/DiffuGTS.

肿瘤分割扩散模型零样本医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。