用非侵入性照片生成血管造影图,提升眼底病诊断准确性
Non-Invasive to Invasive: Enhancing FFA Synthesis from CFP with a Benchmark Dataset and a Novel Network
- 设计扩散引导的生成对抗网络,动态优化图像合成过程
- 在4种眼病数据上实现优于现有方法的生成效果
- 首个多病种配对数据集,适合眼科影像与生成模型研究者
眼底成像在眼科中至关重要,荧光素血管造影(FFA)能更清晰揭示视网膜血管动态与病理变化,但传统方法需注射染料,具有侵入性。本文提出一种基于扩散引导的生成对抗网络,通过自适应扩散过程与类别感知增强模块,实现从非侵入性彩色眼底照片(CFP)到FFA的跨模态生成。为支持该研究,构建了首个涵盖四种眼病的多疾病配对数据集MPOS。实验表明,该方法生成的FFA图像质量优于当前最优方法。进一步引入配对模态诊断网络验证,合成图像结合真实CFP后,在多种眼病诊断中准确率高于对比方法。本工作推动非侵入性成像向功能成像过渡,助力精准诊疗与患者安全。代码与数据集已开源。
原文摘要 · Abstract (English)
Fundus imaging is a pivotal tool in ophthalmology, and different imaging modalities are characterized by their specific advantages. For example, Fundus Fluorescein Angiography (FFA) uniquely provides detailed insights into retinal vascular dynamics and pathology, surpassing Color Fundus Photographs (CFP) in detecting microvascular abnormalities and perfusion status. However, the conventional invasive FFA involves discomfort and risks due to fluorescein dye injection, and it is meaningful but challenging to synthesize FFA images from non-invasive CFP. Previous studies primarily focused on FFA synthesis in a single disease category. In this work, we explore FFA synthesis in multiple diseases by devising a Diffusion-guided generative adversarial network, which introduces an adaptive and dynamic diffusion forward process into the discriminator and adds a category-aware representation enhancer. Moreover, to facilitate this research, we collect the first multi-disease CFP and FFA paired dataset, named the Multi-disease Paired Ocular Synthesis (MPOS) dataset, with four different fundus diseases. Experimental results show that our FFA synthesis network can generate better FFA images compared to state-of-the-art methods. Furthermore, we introduce a paired-modal diagnostic network to validate the effectiveness of synthetic FFA images in the diagnosis of multiple fundus diseases, and the results show that our synthesized FFA images with the real CFP images have higher diagnosis accuracy than that of the compared FFA synthesizing methods. Our research bridges the gap between non-invasive imaging and FFA, thereby offering promising prospects to enhance ophthalmic diagnosis and patient care, with a focus on reducing harm to patients through non-invasive procedures. Our dataset and code will be released to support further research in this field (https://github.com/whq-xxh/FFA-Synthesis).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。