用合成数据提升结肠镜图像息肉分割,自动检测+精细分割一体化
Synthetic Data-Driven Multi-Architecture Framework for Automated Polyp Segmentation Through Integrated Detection and Mask Generation
- 融合Stable Diffusion生成合成数据,结合Faster R-CNN与SAM实现端到端分割
- Faster R-CNN召回率达93.08%,FPN在PSNR和SSIM上最优,达7.21和0.49
- 适合医疗影像自动化、数据稀缺场景下的研究者与临床辅助系统开发者
结肠镜检查是早期诊断结直肠癌的重要手段,而结直肠癌是全球癌症死亡的主要原因之一。本文提出一种多方向架构框架,旨在自动化处理结肠镜图像中的息肉检测,并缓解医疗数据集规模小与标注复杂的问题。系统通过增强版Stable Diffusion生成合成数据,结合检测与分割算法。采用Faster R-CNN进行初始目标定位,随后利用Segment Anything Model(SAM)优化分割掩码。Faster R-CNN达到93.08%的召回率、88.97%的精确率与90.98%的F1分数。进一步评估了五种先进分割模型:U-Net、PSPNet、FPN、LinkNet和MANet,均以ResNet34为骨干网络。结果表明,FPN在PSNR(7.205893)和SSIM(0.492381)上表现最佳;U-Net在召回率(84.85%)上领先;LinkNet在交并比(IoU 64.20%)与Dice分数(77.53%)上表现均衡。
原文摘要 · Abstract (English)
Colonoscopy is a vital tool for the early diagnosis of colorectal cancer, which is one of the main causes of cancer-related mortality globally; hence, it is deemed an essential technique for the prevention and early detection of colorectal cancer. The research introduces a unique multidirectional architectural framework to automate polyp detection within colonoscopy images while helping resolve limited healthcare dataset sizes and annotation complexities. The research implements a comprehensive system that delivers synthetic data generation through Stable Diffusion enhancements together with detection and segmentation algorithms. This detection approach combines Faster R-CNN for initial object localization while the Segment Anything Model (SAM) refines the segmentation masks. The faster R-CNN detection algorithm achieved a recall of 93.08% combined with a precision of 88.97% and an F1 score of 90.98%.SAM is then used to generate the image mask. The research evaluated five state-of-the-art segmentation models that included U-Net, PSPNet, FPN, LinkNet, and MANet using ResNet34 as a base model. The results demonstrate the superior performance of FPN with the highest scores of PSNR (7.205893) and SSIM (0.492381), while UNet excels in recall (84.85%) and LinkNet shows balanced performance in IoU (64.20%) and Dice score (77.53%).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。