提出跨模态通用的眼底图像配准方法,解决多模态数据对齐难题。
Modality-Invariant Coarse-to-Fine Retinal Image Registration

- 基于通用血管分割实现跨模态粗略对齐
- 设计不变性光流网络,完成精细局部配准
- 支持任意眼底模态组合,适合临床长期监测
眼底图像配准对眼科诊断、疾病纵向监测和多模态分析至关重要。现有方法通常依赖特定成像模态:单模态注册中针对单一模态优化,跨模态注册则仅适用于固定模态组合,限制了实际应用中的灵活性。本文提出一种通用的两阶段、模态无关的眼底图像配准框架。首先,基于通用眼底血管分割,构建稀疏特征匹配模型,实现跨模态鲁棒的粗略全局对齐;其次,提出一种模态无关的光流估计网络(MI-RAFT),通过密集局部配准进一步优化对齐精度。大量实验表明,该方法可处理常见眼底成像模态的任意组合,具备强模态不变性,性能优于现有依赖模态的先进方法。
原文摘要 · Abstract (English)
Retinal image registration is essential for ophthalmic diagnosis, longitudinal disease monitoring, and multimodal retinal image analysis. Existing retinal registration methods are typically modality-dependent: they are designed or optimized either for a single imaging modality in mono-modal registration or for a fixed pair of modalities in cross-modal registration. This limits their flexibility and applicability in practical scenarios involving diverse retinal imaging modalities and different combinations of them. In this work, we propose a generalizable two-stage, modality-invariant framework for retinal image registration. First, we introduce a sparse feature-matching model driven by a universal retinal vessel segmentation to achieve robust coarse global alignment across modalities. Second, we develop a modality-invariant optical flow estimation network, termed MI-RAFT, to refine the alignment through dense local registration. Extensive experiments demonstrate that the proposed method can handle diverse combinations of commonly used retinal imaging modalities, exhibiting strong modality invariance while outperforming state-of-the-art modality-dependent registration methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。