arXiv:2409.00726cs.CVcs.AI2024-09被引 9

用少量数据生成高质量眼底造影晚期图像,提升病变细节还原能力。

LPUWF-LDM: Enhanced Latent Diffusion Model for Precise Late-phase UWF-FA Generation on Limited Dataset

  • 引入跨时相区域差异损失,聚焦早期与晚期差异特征。
  • 在扩散过程中增强低频噪声,提升医学图像真实感。
  • 适配小样本场景,适合眼科影像生成研究者使用。

超广角荧光素血管造影(UWF-FA)能精准识别眼病,但注射荧光素可能带来副作用。现有方法通过超广角扫描激光眼底镜(UWF-SLO)生成UWF-FA以减少风险,但在生成晚期相图像时,对病灶区域和细微结构的还原效果不佳。主要挑战在于成对的UWF-SLO与早/晚期UWF-FA数据稀缺,以及病灶区与潜在出血区域的真实感生成需求。本文提出改进的潜空间扩散模型框架(LPUWF-LDM),在有限配对数据下生成高质量晚期相UWF-FA。设计了跨时相区域差异损失,引导模型关注早晚期间的差异;在扩散前向过程引入低频增强噪声策略,提升图像真实性;并采用门控卷积编码器增强变分自编码器映射能力,提升小样本下的信息提取效率。实验表明,该方法在保留精细结构方面表现优异,在有限数据条件下达到当前最佳性能。代码已开源。

原文摘要 · Abstract (English)

Ultra-Wide-Field Fluorescein Angiography (UWF-FA) enables precise identification of ocular diseases using sodium fluorescein, which can be potentially harmful. Existing research has developed methods to generate UWF-FA from Ultra-Wide-Field Scanning Laser Ophthalmoscopy (UWF-SLO) to reduce the adverse reactions associated with injections. However, these methods have been less effective in producing high-quality late-phase UWF-FA, particularly in lesion areas and fine details. Two primary challenges hinder the generation of high-quality late-phase UWF-FA: the scarcity of paired UWF-SLO and early/late-phase UWF-FA datasets, and the need for realistic generation at lesion sites and potential blood leakage regions. This study introduces an improved latent diffusion model framework to generate high-quality late-phase UWF-FA from limited paired UWF images. To address the challenges as mentioned earlier, our approach employs a module utilizing Cross-temporal Regional Difference Loss, which encourages the model to focus on the differences between early and late phases. Additionally, we introduce a low-frequency enhanced noise strategy in the diffusion forward process to improve the realism of medical images. To further enhance the mapping capability of the variational autoencoder module, especially with limited datasets, we implement a Gated Convolutional Encoder to extract additional information from conditional images. Our Latent Diffusion Model for Ultra-Wide-Field Late-Phase Fluorescein Angiography (LPUWF-LDM) effectively reconstructs fine details in late-phase UWF-FA and achieves state-of-the-art results compared to other existing methods when working with limited datasets. Our source code is available at: https://github.com/Tinysqua/****.

医学图像生成扩散模型眼科影像小样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。