将拓扑结构融入对比学习,提升医学图像分析性能
TopoCL: Topological Contrastive Learning for Medical Imaging
- 设计拓扑感知增强,可控扰动同时保留关键医学拓扑特征
- 引入分层拓扑编码器与自适应专家混合模块,融合视觉与拓扑信息
- 在5个数据集上平均提升3.26%分类准确率,适合医学图像表征学习
对比学习已成为从无标签图像中学习表征的强大方法。然而,现有方法主要关注视觉外观特征,忽视了连接模式、边界配置、空腔形成等拓扑特性,这些对医学图像分析具有重要价值。为此,我们提出一种新的拓扑对比学习框架(TopoCL),在对比学习中显式利用医学图像的拓扑结构。首先,引入拓扑感知增强,通过持久性图之间的相对瓶颈距离控制拓扑扰动,保留医学相关的拓扑属性的同时实现可控的结构变化。其次,设计分层拓扑编码器,通过自注意力和交叉注意力机制捕捉拓扑特征。最后,开发自适应专家混合(MoE)模块,动态融合视觉与拓扑表示。TopoCL可无缝集成到现有对比学习方法中。我们在五个代表性对比学习方法(SimCLR、MoCo-v3、BYOL、DINO、Barlow Twins)和五个多样化的医学图像分类数据集上进行评估。实验结果表明,TopoCL实现了持续改进:线性探测分类准确率平均提升+3.26%,具有显著统计意义,验证了其有效性。
原文摘要 · Abstract (English)
Contrastive learning (CL) has become a powerful approach for learning representations from unlabeled images. However, existing CL methods focus predominantly on visual appearance features while neglecting topological characteristics (e.g., connectivity patterns, boundary configurations, cavity formations) that provide valuable cues for medical image analysis. To address this limitation, we propose a new topological CL framework (TopoCL) that explicitly exploits topological structures during contrastive learning for medical imaging. Specifically, we first introduce topology-aware augmentations that control topological perturbations using a relative bottleneck distance between persistence diagrams, preserving medically relevant topological properties while enabling controlled structural variations. We then design a Hierarchical Topology Encoder that captures topological features through self-attention and cross-attention mechanisms. Finally, we develop an adaptive mixture-of-experts (MoE) module to dynamically integrate visual and topological representations. TopoCL can be seamlessly integrated with existing CL methods. We evaluate TopoCL on five representative CL methods (SimCLR, MoCo-v3, BYOL, DINO, and Barlow Twins) and five diverse medical image classification datasets. The experimental results show that TopoCL achieves consistent improvements: an average gain of +3.26% in linear probe classification accuracy with strong statistical significance, verifying its effectiveness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。