提出HybridRetina框架,用全局+局部变形提升眼底图像配准精度。
Progressive Retinal Image Registration via Global and Local Deformable Transformations
- 分步使用关键点与变形网络估计全局与局部形变
- 在FIRE和FLoRI21数据集上优于现有方法
- 聚焦血管区域,提升临床相关结构对齐
眼底图像配准在眼科诊断中至关重要。由于不同图像间视角和解剖结构差异大,基于特征点的方法因鲁棒性和低延迟成为主流。这类方法通常假设视网膜为平面,通过特征匹配获得表示全局变换的单应性矩阵,但视网膜实际近似曲面,导致配准误差,尤其在视角差异大时更显著。为此,我们提出混合配准框架HybridRetina,通过全局与局部可变形变换逐步配准眼底图像。采用关键点检测器和名为GAMorph的变形网络分别估计全局变换与局部可变形变换。特别地,引入多层级像素关系知识指导GAMorph训练,并设计包含图像几何先验的边缘注意力模块,使变形场更关注临床关注的血管区域。在FIRE和FLoRI21两个常用数据集上的实验表明,HybridRetina显著优于多个前沿方法。代码已开源。
原文摘要 · Abstract (English)
Retinal image registration plays an important role in the ophthalmological diagnosis process. Since there exist variances in viewing angles and anatomical structures across different retinal images, keypoint-based approaches become the mainstream methods for retinal image registration thanks to their robustness and low latency. These methods typically assume the retinal surfaces are planar, and adopt feature matching to obtain the homography matrix that represents the global transformation between images. Yet, such a planar hypothesis inevitably introduces registration errors since retinal surface is approximately curved. This limitation is more prominent when registering image pairs with significant differences in viewing angles. To address this problem, we propose a hybrid registration framework called HybridRetina, which progressively registers retinal images with global and local deformable transformations. For that, we use a keypoint detector and a deformation network called GAMorph to estimate the global transformation and local deformable transformation, respectively. Specifically, we integrate multi-level pixel relation knowledge to guide the training of GAMorph. Additionally, we utilize an edge attention module that includes the geometric priors of the images, ensuring the deformation field focuses more on the vascular regions of clinical interest. Experiments on two widely-used datasets, FIRE and FLoRI21, show that our proposed HybridRetina significantly outperforms some state-of-the-art methods. The code is available at https://github.com/lyp-deeplearning/awesome-retinal-registration.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。