arXiv:2505.02779cs.CV2025-05

无需标注数据,用描述子反推关键点,实现医学眼底图像自动配准。

Unsupervised Deep Learning-based Keypoint Localization Estimating Descriptor Matching Performance

  • 用描述子质量反向指导关键点检测,颠覆传统先找点再提特征的思路。
  • 在4个数据集上,无监督描述子性能超越有监督先进方法,检测精度显著提升。
  • 完全无标签设计,适合医疗图像等标注稀缺场景,可拓展至其他模态。

眼底图像配准是临床应用中重要且具挑战性的任务。现有方法依赖带标注的关键点与描述子,但医学图像标注数据稀缺。本文提出一种全无监督配准流程,彻底消除对标注数据的需求。核心思想是:具有独特描述子的位置即为可靠关键点。首先,提出一种无需关键点检测或标签的新型描述子学习方法,可为眼底图像任意位置生成描述子。其次,设计一种全新的无标签关键点检测网络,直接从输入图像估计描述子性能以定位关键点。在四个独立测试集上验证表明,该无监督描述子性能优于现有监督方法,无监督检测器也显著优于已有无监督方案。最终完整配准流程表现接近领先监督方法,且不使用任何标注数据。方法的无标签特性使其可直接迁移至其他领域与成像模态。

原文摘要 · Abstract (English)

Retinal image registration, particularly for color fundus images, is a challenging yet essential task with diverse clinical applications. Existing registration methods for color fundus images typically rely on keypoints and descriptors for alignment; however, a significant limitation is their reliance on labeled data, which is particularly scarce in the medical domain. In this work, we present a novel unsupervised registration pipeline that entirely eliminates the need for labeled data. Our approach is based on the principle that locations with distinctive descriptors constitute reliable keypoints. This fully inverts the conventional state-of-the-art approach, conditioning the detector on the descriptor rather than the opposite. First, we propose an innovative descriptor learning method that operates without keypoint detection or any labels, generating descriptors for arbitrary locations in retinal images. Next, we introduce a novel, label-free keypoint detector network which works by estimating descriptor performance directly from the input image. We validate our method through a comprehensive evaluation on four hold-out datasets, demonstrating that our unsupervised descriptor outperforms state-of-the-art supervised descriptors and that our unsupervised detector significantly outperforms existing unsupervised detection methods. Finally, our full registration pipeline achieves performance comparable to the leading supervised methods, while not employing any labeled data. Additionally, the label-free nature and design of our method enable direct adaptation to other domains and modalities.

医学图像无监督学习关键点检测图像配准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。