融合眼底图与OCT影像,迭代优化实现青光眼精准分割与分级
Joint Segmentation and Grading with Iterative Optimization for Multimodal Glaucoma Diagnosis
- 通过中层特征融合与跨模态对齐,统一处理眼底图与OCT数据
- 采用去噪扩散机制迭代优化,提升视盘和视杯分割精度
- 支持早期青光眼识别,适合临床辅助诊断场景
青光眼早期病变细微,常缺乏明确结构或形态线索,现有方法多依赖单一模态(如眼底图或OCT),仅捕获部分病理信息,易遗漏早期进展。本文提出一种迭代多模态优化模型(IMO),通过中层融合策略整合眼底图与OCT特征,并引入跨模态特征对齐(CMFA)模块以减少模态差异。迭代优化解码器利用去噪扩散机制逐步优化多模态特征,实现视盘与视杯的精细分割,同时支持准确的青光眼分级。大量实验表明,该方法能有效融合多模态信息,提供全面且具有临床意义的青光眼评估方案。源代码已公开于https://github.com/warren-wzw/IMO.git。
原文摘要 · Abstract (English)
Accurate diagnosis of glaucoma is challenging, as early-stage changes are subtle and often lack clear structural or appearance cues. Most existing approaches rely on a single modality, such as fundus or optical coherence tomography (OCT), capturing only partial pathological information and often missing early disease progression. In this paper, we propose an iterative multimodal optimization model (IMO) for joint segmentation and grading. IMO integrates fundus and OCT features through a mid-level fusion strategy, enhanced by a cross-modal feature alignment (CMFA) module to reduce modality discrepancies. An iterative refinement decoder progressively optimizes the multimodal features through a denoising diffusion mechanism, enabling fine-grained segmentation of the optic disc and cup while supporting accurate glaucoma grading. Extensive experiments show that our method effectively integrates multimodal features, providing a comprehensive and clinically significant approach to glaucoma assessment. Source codes are available at https://github.com/warren-wzw/IMO.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。