通过语义相似性改进弱-强一致性,提升医疗图像分割精度
SemSim: Revisiting Weak-to-Strong Consistency from a Semantic Similarity Perspective for Semi-supervised Medical Image Segmentation
- 引入像素级上下文关联图修正预测,增强语义一致性
- 利用特征查询机制缩小标注与未标注数据的类别分布差距
- 适合需要高精度分割的医学影像研究者使用
半监督学习(SSL)在医疗图像分割中可减少对大规模标注数据的依赖。尽管基于弱-强一致性的方法(如FixMatch)在分类任务中表现优异,但在分割任务中仍存在两大缺陷:一是忽略上下文依赖导致相似语义特征预测不一致,造成物体分割不完整;二是未充分挖掘标注与未标注数据间的语义相似性,引发类别分布偏差。为此,本文提出新型框架SemSim,从语义相似性视角出发,设计两项关键机制:(1)通过图像内像素对的亲和性图推理,显式整合上下文信息以修正像素级预测;(2)引入特征查询机制,实现标注与未标注数据间的跨图像解剖结构相似性对齐,促进紧凑类表示学习。为保障语义相似性提取的可靠性,进一步提出空间感知融合模块(SFM),融合多尺度特征以提取显著信息。在三个公开分割基准上的大量实验表明,SemSim在多个指标上持续优于当前最优方法。
原文摘要 · Abstract (English)
Semi-supervised learning (SSL) for medical image segmentation is a challenging yet highly practical task, which reduces reliance on large-scale labeled dataset by leveraging unlabeled samples. Among SSL techniques, the weak-to-strong consistency framework, popularized by FixMatch, has emerged as a state-of-the-art method in classification tasks. Notably, such a simple pipeline has also shown competitive performance in medical image segmentation. However, two key limitations still persist, impeding its efficient adaptation: (1) the neglect of contextual dependencies results in inconsistent predictions for similar semantic features, leading to incomplete object segmentation; (2) the lack of exploitation of semantic similarity between labeled and unlabeled data induces considerable class-distribution discrepancy. To address these limitations, we propose a novel semi-supervised framework based on FixMatch, named SemSim, powered by two appealing designs from semantic similarity perspective: (1) rectifying pixel-wise prediction by reasoning about the intra-image pair-wise affinity map, thus integrating contextual dependencies explicitly into the final prediction; (2) bridging labeled and unlabeled data via a feature querying mechanism for compact class representation learning, which fully considers cross-image anatomical similarities. As the reliable semantic similarity extraction depends on robust features, we further introduce an effective spatial-aware fusion module (SFM) to explore distinctive information from multiple scales. Extensive experiments show that SemSim yields consistent improvements over the state-of-the-art methods across three public segmentation benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。