arXiv:2502.17951cs.CVcs.AI2025-02被引 5

用临床描述生成真实肠镜图像,提升癌症筛查模型泛化能力

Robust Polyp Detection and Diagnosis through Compositional Prompt-Guided Diffusion Models

  • 将病灶位置、报告文本等转化为组合提示,指导扩散模型生成真实图像
  • 在PolypGen数据集上使F1提升2.12%,mAP提高3.09%,尤其擅长处理分布外数据
  • 适合医学影像算法研究者,尤其关注真实世界部署的模型优化

结直肠癌是全球重大健康问题,早期筛查可显著降低死亡率。尽管深度学习在息肉检测、分类与分割上表现良好,但在不同临床环境下的泛化能力仍受限,尤其是面对分布外(OOD)数据时。多中心数据集PolypGen虽有助于缓解此问题,但采集成本高、耗时长。传统数据增强手段难以体现医学图像的复杂性。扩散模型可生成合成息肉图像,但现有方法主要依赖分割掩码作为条件,无法捕捉完整临床背景。为此,我们提出渐进式谱扩散模型(PSDM),将分割掩码、边界框及内窥镜报告等多样临床标注转化为组合提示,并分粗细层次组织,使模型既能把握整体空间结构,又能还原细节特征,生成符合临床实际的合成图像。通过引入PSDM生成样本进行训练数据增强,显著提升了检测、分类与分割性能。例如,在PolypGen数据集上,F1分数提升2.12%,平均精度均值(mAP)提升3.09%,在分布外场景下表现出更强的泛化能力。

原文摘要 · Abstract (English)

Colorectal cancer (CRC) is a significant global health concern, and early detection through screening plays a critical role in reducing mortality. While deep learning models have shown promise in improving polyp detection, classification, and segmentation, their generalization across diverse clinical environments, particularly with out-of-distribution (OOD) data, remains a challenge. Multi-center datasets like PolypGen have been developed to address these issues, but their collection is costly and time-consuming. Traditional data augmentation techniques provide limited variability, failing to capture the complexity of medical images. Diffusion models have emerged as a promising solution for generating synthetic polyp images, but the image generation process in current models mainly relies on segmentation masks as the condition, limiting their ability to capture the full clinical context. To overcome these limitations, we propose a Progressive Spectrum Diffusion Model (PSDM) that integrates diverse clinical annotations-such as segmentation masks, bounding boxes, and colonoscopy reports-by transforming them into compositional prompts. These prompts are organized into coarse and fine components, allowing the model to capture both broad spatial structures and fine details, generating clinically accurate synthetic images. By augmenting training data with PSDM-generated samples, our model significantly improves polyp detection, classification, and segmentation. For instance, on the PolypGen dataset, PSDM increases the F1 score by 2.12% and the mean average precision by 3.09%, demonstrating superior performance in OOD scenarios and enhanced generalization.

医学影像扩散模型数据增强息肉检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。