arXiv:2502.03813cs.CV2025-02被引 14

改进Unet的注意力机制,提升多尺度语义分割精度

Optimized Unet with Attention Mechanism for Multi-Scale Semantic Segmentation

  • 引入通道与空间注意力模块,强化关键特征关注
  • 在Cityscapes上达到76.5% mIoU和95.3%像素准确率
  • 适合自动驾驶、医学影像等复杂场景应用

语义分割是计算机视觉的核心任务,旨在对图像中每个像素进行精确分类。传统Unet模型通过编码器-解码器结构实现高效特征提取与融合,但在处理复杂背景、长距离依赖及多尺度目标时仍存在局限。为此,本文提出一种结合注意力机制的改进Unet模型,引入通道注意力与空间注意力模块,增强模型对重要特征的关注能力,并通过多尺度特征融合策略优化跳跃连接,从而提升全局语义信息与细粒度特征的融合效果。实验基于Cityscapes数据集,与FCN、SegNet、DeepLabv3+、PSPNet等经典模型对比,该模型在mIoU和像素准确率(PA)上分别达到76.5%和95.3%,验证了其在复杂场景与模糊目标边界下的优越性能。此外,本文探讨了该模型在实际应用中的潜力及未来扩展方向,表明其在自动驾驶、遥感图像分析和医学图像处理等领域具有广泛应用价值。

原文摘要 · Abstract (English)

Semantic segmentation is one of the core tasks in the field of computer vision, and its goal is to accurately classify each pixel in an image. The traditional Unet model achieves efficient feature extraction and fusion through an encoder-decoder structure, but it still has certain limitations when dealing with complex backgrounds, long-distance dependencies, and multi-scale targets. To this end, this paper proposes an improved Unet model combined with an attention mechanism, introduces channel attention and spatial attention modules, enhances the model's ability to focus on important features, and optimizes skip connections through a multi-scale feature fusion strategy, thereby improving the combination of global semantic information and fine-grained features. The experiment is based on the Cityscapes dataset and compared with classic models such as FCN, SegNet, DeepLabv3+, and PSPNet. The improved model performs well in terms of mIoU and pixel accuracy (PA), reaching 76.5% and 95.3% respectively. The experimental results verify the superiority of this method in dealing with complex scenes and blurred target boundaries. In addition, this paper discusses the potential of the improved model in practical applications and future expansion directions, indicating that it has broad application value in fields such as autonomous driving, remote sensing image analysis, and medical image processing.

语义分割注意力机制Unet多尺度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。