arXiv:2410.21130cs.CV2024-10中稿 · BIBM 2024被引 1

用扩散模型从不规则眼底图像序列外推未来病变,提升青光眼预测精度。

Extrapolating Prospective Glaucoma Fundus Images through Diffusion Model in Irregular Longitudinal Sequences

  • 基于扩散模型,从不规则时间序列眼底图生成未来图像。
  • 在真实数据上生成图像质量高,下游分类准确率显著提升。
  • 适合眼科医生和医学影像研究者用于疾病进展分析。

利用纵向数据集进行青光眼进展预测,有助于支持早期治疗干预。现有方法多直接预测青光眼分期标签,但难以捕捉疾病细微演变轨迹。为此,我们提出一种基于扩散模型的新方法,通过现有纵向眼底图像序列外推未来图像。该方法以图像序列作为输入,采用时间对齐掩码选择特定年份生成图像。训练阶段使用时间对齐掩码解决纵向图像采样中不规则时间间隔问题,并随机掩码序列中一帧作为真实标签,帮助网络持续学习序列内部关系。此外,引入文本标签对生成图像进行分类。实验结果表明,所提模型不仅能有效生成纵向数据,还显著提升下游分类任务的精度。

原文摘要 · Abstract (English)

The utilization of longitudinal datasets for glaucoma progression prediction offers a compelling approach to support early therapeutic interventions. Predominant methodologies in this domain have primarily focused on the direct prediction of glaucoma stage labels from longitudinal datasets. However, such methods may not adequately encapsulate the nuanced developmental trajectory of the disease. To enhance the diagnostic acumen of medical practitioners, we propose a novel diffusion-based model to predict prospective images by extrapolating from existing longitudinal fundus images of patients. The methodology delineated in this study distinctively leverages sequences of images as inputs. Subsequently, a time-aligned mask is employed to select a specific year for image generation. During the training phase, the time-aligned mask resolves the issue of irregular temporal intervals in longitudinal image sequence sampling. Additionally, we utilize a strategy of randomly masking a frame in the sequence to establish the ground truth. This methodology aids the network in continuously acquiring knowledge regarding the internal relationships among the sequences throughout the learning phase. Moreover, the introduction of textual labels is instrumental in categorizing images generated within the sequence. The empirical findings from the conducted experiments indicate that our proposed model not only effectively generates longitudinal data but also significantly improves the precision of downstream classification tasks.

青光眼扩散模型图像生成纵向数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。