arXiv:2509.06885cs.CVcs.AI2025-09

用自监督预训练的轻量级分割模型,实时处理医学图像。

Barlow-Swin: Toward a novel siamese-based segmentation architecture using Swin-Transformers

  • 结合Swin编码器与U-Net解码器,通过跳跃连接保留细节。
  • 参数量少、推理快,在基准测试中精度接近主流模型。
  • 适合资源受限或需实时响应的临床部署场景。

医学图像分割在临床流程中至关重要,尤其用于病灶区域的检测与勾画。尽管卷积网络如U-Net已成为标准,但其感受野有限,难以建模全局上下文。近期融合Transformer的方法虽有所改进,但常导致深层且计算开销大的模型,不适用于实时应用。本文提出一种新型端到端轻量级架构,专为实时二值医学图像分割设计。模型采用类Swin Transformer的编码器与类U-Net的解码器,通过跳跃路径连接以保留空间细节并捕捉上下文信息。与现有结构不同,该架构显著更浅,计算效率高。为增强编码器在小标注数据下的特征学习能力,我们首先使用Barlow Twins进行自监督预训练,减少冗余特征,聚焦关键模式;随后对全模型进行微调。在多个基准二值分割任务上的实验表明,该模型在参数量大幅减少、推理速度更快的同时,仍保持竞争力的精度,是实时与资源受限临床环境中的实用替代方案。代码已开源:https://github.com/mkianih/Barlow-Swin。

原文摘要 · Abstract (English)

Medical image segmentation is a critical task in clinical workflows, particularly for the detection and delineation of pathological regions. While convolutional architectures like U-Net have become standard for such tasks, their limited receptive field restricts global context modeling. Recent efforts integrating transformers have addressed this, but often result in deep, computationally expensive models unsuitable for real-time use. In this work, we present a novel end-to-end lightweight architecture designed specifically for real-time binary medical image segmentation. Our model combines a Swin Transformer-like encoder with a U-Net-like decoder, connected via skip pathways to preserve spatial detail while capturing contextual information. Unlike existing designs such as Swin Transformer or U-Net, our architecture is significantly shallower and competitively efficient. To improve the encoder's ability to learn meaningful features without relying on large amounts of labeled data, we first train it using Barlow Twins, a self-supervised learning method that helps the model focus on important patterns by reducing unnecessary repetition in the learned features. After this pretraining, we fine-tune the entire model for our specific task. Experiments on benchmark binary segmentation tasks demonstrate that our model achieves competitive accuracy with substantially reduced parameter count and faster inference, positioning it as a practical alternative for deployment in real-time and resource-limited clinical environments. The code for our method is available at Github repository: https://github.com/mkianih/Barlow-Swin.

医学图像分割模型轻量化自监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。