arXiv:2501.16679cs.CV2025-01ICRA被引 13

用扩散模型自动生成逼真多样的肠镜息肉图像,提升诊断系统训练数据质量。

Polyp-Gen: Realistic and Diverse Polyp Image Generation for Endoscopic Dataset Expansion

  • 基于空间感知的扩散模型,精准生成息肉边界细节。
  • 合成图像使下游检测任务性能提升,零样本迁移能力突出。
  • 无需人工标注位置,适合医学影像数据稀缺场景使用。

自动化诊断系统(ADS)在内镜检查中早期发现息肉方面展现出巨大潜力,有助于降低结直肠癌发病率。然而,由于标注成本高和隐私限制,获取高质量内镜图像面临巨大挑战。尽管已有合成图像生成方法用于数据集扩展,但现有算法难以准确生成息肉边界细节,且通常需依赖医学先验指定息肉位置与形状,限制了生成图像的真实感与多样性。为此,我们提出Polyp-Gen,首个全自动化基于扩散模型的内镜图像生成框架。具体而言,设计了一种空间感知的扩散训练方案,结合病灶引导损失,增强息肉边界结构上下文;同时引入分层检索采样策略,匹配细粒度空间特征以捕捉息肉可能区域的医学先验。该方法可生成真实且多样化的内镜图像,支持构建可靠的ADS。大量实验表明,生成图像达到当前最佳质量,且能显著提升下游息肉检测性能。此外,Polyp-Gen在其他数据集上展现出优异的零样本泛化能力。源代码已开源:https://github.com/CUHK-AIM-Group/Polyp-Gen。

原文摘要 · Abstract (English)

Automated diagnostic systems (ADS) have shown significant potential in the early detection of polyps during endoscopic examinations, thereby reducing the incidence of colorectal cancer. However, due to high annotation costs and strict privacy concerns, acquiring high-quality endoscopic images poses a considerable challenge in the development of ADS. Despite recent advancements in generating synthetic images for dataset expansion, existing endoscopic image generation algorithms failed to accurately generate the details of polyp boundary regions and typically required medical priors to specify plausible locations and shapes of polyps, which limited the realism and diversity of the generated images. To address these limitations, we present Polyp-Gen, the first full-automatic diffusion-based endoscopic image generation framework. Specifically, we devise a spatial-aware diffusion training scheme with a lesion-guided loss to enhance the structural context of polyp boundary regions. Moreover, to capture medical priors for the localization of potential polyp areas, we introduce a hierarchical retrieval-based sampling strategy to match similar fine-grained spatial features. In this way, our Polyp-Gen can generate realistic and diverse endoscopic images for building reliable ADS. Extensive experiments demonstrate the state-of-the-art generation quality, and the synthetic images can improve the downstream polyp detection task. Additionally, our Polyp-Gen has shown remarkable zero-shot generalizability on other datasets. The source code is available at https://github.com/CUHK-AIM-Group/Polyp-Gen.

医学图像生成扩散模型息肉检测数据增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。