解决医学影像生成中纹理与形状的冲突,提升3DTransformer对解剖边界的识别能力
The Texture-Shape Dilemma: Boundary-Safe Synthetic Generation for 3D Medical Transformers
- 分区域合成:先建边界保护区,再注入物理驱动纹理
- 在BTCV和MSD数据集上分别提升1.43%和1.51%的分割性能
- 无需真实患者数据,适合隐私敏感的医学影像训练
视觉变压器(ViTs)在医学图像分析中表现卓越,但其对大量数据的需求与临床数据稀缺及隐私限制相冲突。公式驱动的监督学习(FDSL)通过数学公式生成无限带标注样本,避免使用真实患者数据,成为可行方案。然而现有FDSL方法仅依赖均匀强度的简单几何形状,忽视了CT和MRI中固有的组织纹理与噪声模式。本文揭示了一种关键优化矛盾——边界混叠:当高频纹理被直接添加时,会破坏图像梯度信号,导致模型无法准确学习解剖边界。为此,我们提出物理启发的空间解耦合成框架。该方法将生成过程解耦:首先基于边界距离构建梯度保护缓冲区,确保形状学习稳定;随后在物体核心注入物理驱动的频谱纹理。该设计有效平衡了鲁棒的形状表征与对成像噪声的不变性。在BTCV和MSD数据集上的大量实验表明,本方法显著优于先前FDSL及基于真实数据的自监督学习方法,在BTCV上提升1.43%,在MSD上最高提升1.51%,为医学视觉变压器提供可扩展、无标注的基础训练方案。代码将在接受后公开。
原文摘要 · Abstract (English)
Vision Transformers (ViTs) have revolutionized medical image analysis, yet their data-hungry nature clashes with the scarcity and privacy constraints of clinical archives. Formula-Driven Supervised Learning (FDSL) has emerged as a promising solution to this bottleneck, synthesizing infinite annotated samples from mathematical formulas without utilizing real patient data. However, existing FDSL paradigms rely on simple geometric shapes with homogeneous intensities, creating a substantial gap by neglecting tissue textures and noise patterns inherent in modalities like CT and MRI. In this paper, we identify a critical optimization conflict termed boundary aliasing: when high-frequency synthetic textures are naively added, they corrupt the image gradient signals necessary for learning structural boundaries, causing the model to fail in delineating real anatomical margins. To bridge this gap, we propose a novel Physics-inspired Spatially-Decoupled Synthesis framework. Our approach orthogonalizes the synthesis process: it first constructs a gradient-shielded buffer zone based on boundary distance to ensure stable shape learning, and subsequently injects physics-driven spectral textures into the object core. This design effectively reconciles robust shape representation learning with invariance to acquisition noise. Extensive experiments on the BTCV and MSD datasets demonstrate that our method significantly outperforms previous FDSL, as well as SSL methods trained on real-world medical datasets, by 1.43% on BTCV and up to 1.51% on MSD task, offering a scalable, annotation-free foundation for medical ViTs. The code will be made publicly available upon acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。