用无配对数据训练模型,恢复白内障患者的模糊眼底图像。
Versatile Cataract Fundus Image Restoration Model Utilizing Unpaired Cataract and High-quality Images
- 基于GAN的无监督合成模型生成真实感白内障图像。
- 恢复模型在真实数据上达到39.03 PSNR、0.9476 SSIM。
- 适用于多数据集,助力医生术前诊断其他眼病。
白内障是导致失明的常见眼病,手术可治疗,但患者常伴发其他致盲眼病,需术前诊断。白内障患者眼底图像因晶状体浑浊而模糊,难以观察视网膜血管,影响诊断。为此,本文提出新型白内障图像恢复方法Catintell,包含两个模块:Catintell-Syn利用无监督生成对抗网络(GAN)合成具有真实风格与纹理的配对白内障图像,替代传统高斯退化方法;Catintell-Res为图像恢复网络,通过学习合成数据提升真实白内障眼底图像质量。大量实验表明,该模型在真实数据上取得39.03的PSNR和0.9476的SSIM,优于现有方法。且其从无配对数据中学习的通用恢复能力可适应多个数据集。本工作有望辅助眼科医生识别白内障患者合并的眼病,并推动医学图像恢复技术发展。
原文摘要 · Abstract (English)
Cataract is one of the most common blinding eye diseases and can be treated by surgery. However, because cataract patients may also suffer from other blinding eye diseases, ophthalmologists must diagnose them before surgery. The cloudy lens of cataract patients forms a hazy degeneration in the fundus images, making it challenging to observe the patient's fundus vessels, which brings difficulties to the diagnosis process. To address this issue, this paper establishes a new cataract image restoration method named Catintell. It contains a cataract image synthesizing model, Catintell-Syn, and a restoration model, Catintell-Res. Catintell-Syn uses GAN architecture with fully unsupervised data to generate paired cataract-like images with realistic style and texture rather than the conventional Gaussian degradation algorithm. Meanwhile, Catintell-Res is an image restoration network that can improve the quality of real cataract fundus images using the knowledge learned from synthetic cataract images. Extensive experiments show that Catintell-Res outperforms other cataract image restoration methods in PSNR with 39.03 and SSIM with 0.9476. Furthermore, the universal restoration ability that Catintell-Res gained from unpaired cataract images can process cataract images from various datasets. We hope the models can help ophthalmologists identify other blinding eye diseases of cataract patients and inspire more medical image restoration methods in the future.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。