无需标注数据,用自注意力扩散模型实现医学图像零样本分割。
Self-Attention Diffusion Models for Zero-Shot Biomedical Image Segmentation: Unlocking New Frontiers in Medical Imaging
- 基于预训练扩散模型的自注意力机制,实现无标注条件下的医学图像分割。
- 在皮肤病变、胸片感染等任务上,Dice得分达88.7%~92.9%,IoU达66.3%~93.3%。
- 适合缺乏标注数据的医疗场景,推动AI在新影像任务中快速部署。
医学图像分割是生物医学分析中的核心挑战。尽管已有研究探索大规模监督训练和无监督训练以实现跨模态分割,但实现无需任何标注的零样本分割仍具难度。本文提出注意力扩散零样本无监督系统(ADZUS),利用自注意力扩散模型实现零样本医学图像分割。该方法依托预训练扩散模型的生成与判别能力,无需标注数据或领域先验知识即可完成分割。通过集成自注意力机制,模型能捕捉上下文信息并保留细节。在皮肤病变、胸部X光感染及白血球分割等多个数据集上的实验表明,ADZUS取得领先性能:Dice分数在88.7%至92.9%之间,IoU在66.3%至93.3%之间,显著提升对未见医学图像的处理能力。尽管计算开销大、耗时长,其在零样本设置下的高效性为减少人工标注依赖、快速适配新任务提供了可能,有望拓展AI医疗影像的诊断能力。
原文摘要 · Abstract (English)
Producing high-quality segmentation masks for medical images is a fundamental challenge in biomedical image analysis. Recent research has explored large-scale supervised training to enable segmentation across various medical imaging modalities and unsupervised training to facilitate segmentation without dense annotations. However, constructing a model capable of segmenting diverse medical images in a zero-shot manner without any annotations remains a significant hurdle. This paper introduces the Attention Diffusion Zero-shot Unsupervised System (ADZUS), a novel approach that leverages self-attention diffusion models for zero-shot biomedical image segmentation. ADZUS harnesses the intrinsic capabilities of pre-trained diffusion models, utilizing their generative and discriminative potentials to segment medical images without requiring annotated training data or prior domain-specific knowledge. The ADZUS architecture is detailed, with its integration of self-attention mechanisms that facilitate context-aware and detail-sensitive segmentations being highlighted. Experimental results across various medical imaging datasets, including skin lesion segmentation, chest X-ray infection segmentation, and white blood cell segmentation, reveal that ADZUS achieves state-of-the-art performance. Notably, ADZUS reached Dice scores ranging from 88.7\% to 92.9\% and IoU scores from 66.3\% to 93.3\% across different segmentation tasks, demonstrating significant improvements in handling novel, unseen medical imagery. It is noteworthy that while ADZUS demonstrates high effectiveness, it demands substantial computational resources and extended processing times. The model's efficacy in zero-shot settings underscores its potential to reduce reliance on costly annotations and seamlessly adapt to new medical imaging tasks, thereby expanding the diagnostic capabilities of AI-driven medical imaging technologies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。