arXiv:2412.12778cs.CVcs.AI2024-12被引 1

用扩散模型从非侵入性眼底图生成荧光造影图,解决数据少、病种多难题。

Rethinking Diffusion-Based Image Generators for Fundus Fluorescein Angiography Synthesis on Limited Data

  • 基于潜空间扩散模型,设计微调协议应对小样本挑战。
  • 在有限数据下生成效果优于现有方法,覆盖多种疾病和模态。
  • 适合眼科医学图像生成研究者,推动无创诊断发展。

眼底成像是眼科关键工具,不同成像方式各有优势。例如,眼底荧光血管造影(FFA)能精准识别眼疾。但传统侵入式FFA需注射氟黄素钠,带来不适与风险。从非侵入性眼底图像生成对应FFA图像具有重要实用价值,但也面临双重挑战:一是数据集有限制约模型性能;二是以往研究多针对单一疾病或模态,对复杂患者群体表现不佳。为此,我们提出一种基于潜空间扩散模型的框架Diffusion,引入微调协议以克服医疗数据稀缺问题,并释放扩散模型的生成潜力。同时,设计新方法应对跨模态与多病种生成难题。在有限数据下,本框架性能达到当前最优,显著提升眼科诊断与患者护理潜力。代码即将开源,支持该领域进一步研究。

原文摘要 · Abstract (English)

Fundus imaging is a critical tool in ophthalmology, with different imaging modalities offering unique advantages. For instance, fundus fluorescein angiography (FFA) can accurately identify eye diseases. However, traditional invasive FFA involves the injection of sodium fluorescein, which can cause discomfort and risks. Generating corresponding FFA images from non-invasive fundus images holds significant practical value but also presents challenges. First, limited datasets constrain the performance and effectiveness of models. Second, previous studies have primarily focused on generating FFA for single diseases or single modalities, often resulting in poor performance for patients with various ophthalmic conditions. To address these issues, we propose a novel latent diffusion model-based framework, Diffusion, which introduces a fine-tuning protocol to overcome the challenge of limited medical data and unleash the generative capabilities of diffusion models. Furthermore, we designed a new approach to tackle the challenges of generating across different modalities and disease types. On limited datasets, our framework achieves state-of-the-art results compared to existing methods, offering significant potential to enhance ophthalmic diagnostics and patient care. Our code will be released soon to support further research in this field.

医学图像生成扩散模型眼底图像小样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。