arXiv:2504.17935cs.CVeess.IV2025-04

针对血液中小物体分割难题,提出小尺度掩码策略提升模型表现。

Masked strategies for images with small objects

  • 采用小掩码比和小块尺寸的MAE,保留小物体的全局上下文信息
  • 使用预训练编码器微调U-Net Transformer,显著提升小物体分割精度
  • 适用于医学图像中微小结构的检测与分类任务

血细胞检测与分类在血液分析中面临挑战,尤其当目标为大背景中像素级的小物体时。尽管基于预训练权重的深度学习模型(如残差网络、视觉变换器)在多个领域表现良好,但其在非训练域图像上性能下降。自监督方法可通过掩码自动编码器(MAE)学习通用表征,通过遮蔽图像区域并重建实现。然而,若物体尺寸小于掩码大小,则全局上下文丢失,重建困难。本研究探讨了掩码比例与块尺寸对血液成分的影响,采用小尺度MAE获取ViT编码器表征,并将编码器权重用于训练U-Net Transformer进行语义分割,融合局部与全局信息。实验表明,更小的掩码比例与块尺寸可提升重建效果;对比实验显示,预训练权重显著改善小物体分割性能。该方法为小物体分割提供高效有效策略。

原文摘要 · Abstract (English)

The hematology analytics used for detection and classification of small blood components is a significant challenge. In particular, when objects exists as small pixel-sized entities in a large context of similar objects. Deep learning approaches using supervised models with pre-trained weights, such as residual networks and vision transformers have demonstrated success for many applications. Unfortunately, when applied to images outside the domain of learned representations, these methods often result with less than acceptable performance. A strategy to overcome this can be achieved by using self-supervised models, where representations are learned and weights are then applied for downstream applications. Recently, masked autoencoders have proven to be effective to obtain representations that captures global context information. By masking regions of an image and having the model learn to reconstruct both the masked and non-masked regions, weights can be used for various applications. However, if the sizes of the objects in images are less than the size of the mask, the global context information is lost, making it almost impossible to reconstruct the image. In this study, we investigated the effect of mask ratios and patch sizes for blood components using a MAE to obtain learned ViT encoder representations. We then applied the encoder weights to train a U-Net Transformer for semantic segmentation to obtain both local and global contextual information. Our experimental results demonstrates that both smaller mask ratios and patch sizes improve the reconstruction of images using a MAE. We also show the results of semantic segmentation with and without pre-trained weights, where smaller-sized blood components benefited with pre-training. Overall, our proposed method offers an efficient and effective strategy for the segmentation and classification of small objects.

小物体分割医学图像自监督学习视觉变换器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。