arXiv:2601.08078cs.CVcs.CE2026-01被引 5

用DINOv3特征提升少样本医学图像分割,效果显著优于现有方法。

Exploiting DINOv3-Based Self-Supervised Features for Robust Few-Shot Medical Image Segmentation

  • 引入小波域增强与上下文引导融合,提升特征多样性与语义表达。
  • 在六大数据集上实现少样本条件下分割性能领先,最高提升达4.2%。
  • 适合医疗图像分析、少样本学习研究者快速应用与参考。

基于深度学习的自动医学图像分割在临床诊断与治疗规划中至关重要,但在标注数据稀缺的少样本场景下仍具挑战。近期,如DINOv3等在大规模自然图像上预训练的自监督基础模型展现出强大的密集特征提取能力,有助于缓解少样本学习难题。然而,其直接应用于医学图像受限于领域差异。本文提出DINO-AugSeg框架,利用DINOv3特征解决少样本医学图像分割问题。具体包括:引入基于小波的特征级增强模块WT-Aug,通过扰动频域成分丰富DINOv3提取特征的多样性;设计上下文信息引导融合模块CG-Fuse,利用交叉注意力将语义丰富的低分辨率特征与空间细节丰富的高分辨率特征有效融合。在涵盖五种成像模态(MRI、CT、超声、内窥镜、皮肤镜)的六个公开基准上的大量实验表明,DINO-AugSeg在有限样本条件下持续优于现有方法。结果验证了小波域增强与上下文融合对鲁棒特征表示的有效性,表明DINO-AugSeg是推进少样本医学图像分割的有前景方向。代码与数据将发布于https://github.com/apple1986/DINO-AugSeg。

原文摘要 · Abstract (English)

Deep learning-based automatic medical image segmentation plays a critical role in clinical diagnosis and treatment planning but remains challenging in few-shot scenarios due to the scarcity of annotated training data. Recently, self-supervised foundation models such as DINOv3, which were trained on large natural image datasets, have shown strong potential for dense feature extraction that can help with the few-shot learning challenge. Yet, their direct application to medical images is hindered by domain differences. In this work, we propose DINO-AugSeg, a novel framework that leverages DINOv3 features to address the few-shot medical image segmentation challenge. Specifically, we introduce WT-Aug, a wavelet-based feature-level augmentation module that enriches the diversity of DINOv3-extracted features by perturbing frequency components, and CG-Fuse, a contextual information-guided fusion module that exploits cross-attention to integrate semantic-rich low-resolution features with spatially detailed high-resolution features. Extensive experiments on six public benchmarks spanning five imaging modalities, including MRI, CT, ultrasound, endoscopy, and dermoscopy, demonstrate that DINO-AugSeg consistently outperforms existing methods under limited-sample conditions. The results highlight the effectiveness of incorporating wavelet-domain augmentation and contextual fusion for robust feature representation, suggesting DINO-AugSeg as a promising direction for advancing few-shot medical image segmentation. Code and data will be made available on https://github.com/apple1986/DINO-AugSeg.

医学图像少样本学习自监督分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。