arXiv:2507.02581cs.CV2025-07ICCV被引 8

让3D医学图像自监督学习更懂解剖结构差异。

Structure-aware Semantic Discrepancy and Consistency for 3D Medical Image Self-supervised Learning

  • 基于结构内语义一致、跨结构语义相异的假设设计新方法
  • 在10个数据集上均超越现有最佳自监督模型
  • 适合需要精准解剖理解的医学影像研究者

3D医学图像自监督学习(mSSL)在医学分析中潜力巨大。为支持更广泛应用,需考虑解剖结构在位置、尺度和形态上的变化,这些是捕捉有意义区别的关键。然而,以往mSSL方法使用固定尺寸块划分图像,常忽略结构变化。本文提出一种新视角,旨在学习结构感知的表示。我们假设同一结构内的块具有相同语义(语义一致性),而不同结构的块则语义不同(语义差异)。基于此,提出名为$S^2DC$的mSSL框架,分两步实现结构感知的语义差异与一致性:首先,利用最优传输策略使不同块表示相异,增强语义差异;其次,基于邻域相似性分布,在结构层面推进语义一致性。通过连接块级与结构级表示,$S^2DC$实现结构感知表示。在10个数据集、4项任务、3种模态上全面评估,所提方法持续优于现有最先进mSSL方法。

原文摘要 · Abstract (English)

3D medical image self-supervised learning (mSSL) holds great promise for medical analysis. Effectively supporting broader applications requires considering anatomical structure variations in location, scale, and morphology, which are crucial for capturing meaningful distinctions. However, previous mSSL methods partition images with fixed-size patches, often ignoring the structure variations. In this work, we introduce a novel perspective on 3D medical images with the goal of learning structure-aware representations. We assume that patches within the same structure share the same semantics (semantic consistency) while those from different structures exhibit distinct semantics (semantic discrepancy). Based on this assumption, we propose an mSSL framework named $S^2DC$, achieving Structure-aware Semantic Discrepancy and Consistency in two steps. First, $S^2DC$ enforces distinct representations for different patches to increase semantic discrepancy by leveraging an optimal transport strategy. Second, $S^2DC$ advances semantic consistency at the structural level based on neighborhood similarity distribution. By bridging patch-level and structure-level representations, $S^2DC$ achieves structure-aware representations. Thoroughly evaluated across 10 datasets, 4 tasks, and 3 modalities, our proposed method consistently outperforms the state-of-the-art methods in mSSL.

医学图像自监督学习3D结构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。