用扩散模型提升胶囊内镜低分辨率图像,更真实还原胃部细微结构。
Super-Resolution Enhancement of Medical Images Based on Diffusion Model: An Optimization Scheme for Low-Resolution Gastric Images
- 基于扩散模型的图像超分辨率框架,学习低清到高清的概率映射。
- 在HyperKvasir数据集上达到29.3 dB PSNR和0.71 SSIM,优于GAN方法。
- 适合医学影像增强,尤其适用于硬件受限的胶囊内镜应用。
胶囊内镜实现了微创胃肠成像,但受硬件、功耗和传输限制,图像固有分辨率低,影响对黏膜纹理和细微病灶的识别,阻碍早期诊断。本文提出一种基于扩散模型的超分辨率框架,以数据驱动且解剖一致的方式增强胶囊内镜图像。采用基于去噪扩散概率模型(DDPM)的SR3框架,学习从低分辨率到高分辨率的映射。相比易产生训练不稳定和幻觉伪影的GAN方法,扩散模型提供稳定似然训练和更好结构保真度。在大规模公开的HyperKvasir数据集上训练与评估。定量结果显示,所提方法显著优于双三次插值和ESRGAN等GAN方法,基线模型达27.5 dB PSNR和0.65 SSIM,加入注意力机制后提升至29.3 dB和0.71。定性结果表明,血管纹路、解剖边界和病灶结构得到更好保留。研究证明,扩散模型超分辨率是提升非侵入性医学影像的有力手段,尤其适用于分辨率受限的胶囊内镜场景。
原文摘要 · Abstract (English)
Capsule endoscopy has enabled minimally invasive gastrointestinal imaging, but its clinical utility is limited by the inherently low resolution of captured images due to hardware, power, and transmission constraints. This limitation hampers the identification of fine-grained mucosal textures and subtle pathological features essential for early diagnosis. This work investigates a diffusion-based super-resolution framework to enhance capsule endoscopy images in a data-driven and anatomically consistent manner. We adopt the SR3 (Super-Resolution via Repeated Refinement) framework built upon Denoising Diffusion Probabilistic Models (DDPMs) to learn a probabilistic mapping from low-resolution to high-resolution images. Unlike GAN-based approaches that often suffer from training instability and hallucination artifacts, diffusion models provide stable likelihood-based training and improved structural fidelity. The HyperKvasir dataset, a large-scale publicly available gastrointestinal endoscopy dataset, is used for training and evaluation. Quantitative results demonstrate that the proposed method significantly outperforms bicubic interpolation and GAN-based super-resolution methods such as ESRGAN, achieving PSNR of 27.5 dB and SSIM of 0.65 for a baseline model, and improving to 29.3 dB and 0.71 with architectural enhancements including attention mechanisms. Qualitative results show improved preservation of anatomical boundaries, vascular patterns, and lesion structures. These findings indicate that diffusion-based super-resolution is a promising approach for enhancing non-invasive medical imaging, particularly in capsule endoscopy where image resolution is fundamentally constrained.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。