arXiv:2502.05282cs.CVcs.AI2025-02TPAMI被引 12

提出GEMINI方法,用拓扑保持机制解决医学图像密集对比学习中的误正负样本问题。

Homeomorphism Prior for False Positive and Negative Problem in Medical Image Dense Contrastive Representation Learning

论文配图:Homeomorphism Prior for False Positive and Negative Problem in Medical Image Dense Contrastive Representation Learning
图 1 · 摘自论文原文
  • 引入可变形拓扑学习,通过保持图像拓扑结构来精准预测像素对应关系。
  • 在7个数据集上优于现有方法,显著降低误正负对数量并提升表示学习效果。
  • 适合医学图像分析、密集预测任务的研究者,尤其关注标注效率与模型可靠性的人群。

密集对比表示学习(DCRL)显著提升了图像密集预测任务的学习效率,具有降低医学图像收集与密集标注成本的巨大潜力。然而,医学图像的特性导致对应关系难以可靠发现,带来大规模误正负对(FP&N)这一开放性难题。本文提出几何视觉密集相似性(GEMINI)学习,将拓扑先验嵌入DCRL,实现可靠的对应关系发现。我们设计可变形拓扑学习(DHL),建模医学图像的拓扑性质,学习可变形映射以在拓扑保持下预测像素对应关系,有效缩小配对搜索空间,并通过梯度隐式软化负样本学习。同时提出几何语义相似性(GSS),从特征中提取语义信息以衡量对应关系对齐程度,提升形变学习效率与性能,构建可靠正样本。我们在两个典型表示学习任务中实现两种实用变体,实验在七个数据集上验证了优越性,结果显著优于现有方法。代码将通过配套链接公开:https://github.com/YutingHe-list/GEMINI。

原文摘要 · Abstract (English)

Dense contrastive representation learning (DCRL) has greatly improved the learning efficiency for image-dense prediction tasks, showing its great potential to reduce the large costs of medical image collection and dense annotation. However, the properties of medical images make unreliable correspondence discovery, bringing an open problem of large-scale false positive and negative (FP&N) pairs in DCRL. In this paper, we propose GEoMetric vIsual deNse sImilarity (GEMINI) learning which embeds the homeomorphism prior to DCRL and enables a reliable correspondence discovery for effective dense contrast. We propose a deformable homeomorphism learning (DHL) which models the homeomorphism of medical images and learns to estimate a deformable mapping to predict the pixels' correspondence under topological preservation. It effectively reduces the searching space of pairing and drives an implicit and soft learning of negative pairs via a gradient. We also propose a geometric semantic similarity (GSS) which extracts semantic information in features to measure the alignment degree for the correspondence learning. It will promote the learning efficiency and performance of deformation, constructing positive pairs reliably. We implement two practical variants on two typical representation learning tasks in our experiments. Our promising results on seven datasets which outperform the existing methods show our great superiority. We will release our code on a companion link: https://github.com/YutingHe-list/GEMINI.

医学图像对比学习拓扑先验密集预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。