arXiv:2502.14014eess.IV2025-02被引 3

用轻量残差解码器和RetNet提升语义分割效率与精度

SegRet: An Efficient Design for Semantic Segmentation with Retentive Network

  • 采用零初始化残差解码器,保持计算轻量化
  • 在ADE20K等数据集上达顶尖性能,参数量显著减少
  • 适合自动驾驶等对效率敏感的实时场景

随着自动驾驶和智能交通系统快速发展,语义分割愈发关键。精确解析真实环境是这些应用的基础。然而,传统方法难以兼顾模型性能与计算效率,尤其在参数量方面存在瓶颈。为此,我们提出SegRet,基于Retentive Network(RetNet)架构并结合轻量级残差解码器(含零初始化)。该模型具备三大优势:(1) 轻量残差解码器:通过在残差结构中嵌入零初始化层,保持解码器计算简洁且不丢失信息;(2) 强鲁棒特征提取:采用RetNet作为主干网络,有效捕捉层级图像特征,提升表示质量;(3) 参数高效:在ADE20K、Cityscapes和COCO-Stuff等主流基准上达到当前最优(SOTA)分割性能,同时显著减少参数量,实现高精度且无额外计算负担。全面实验证明其有效性与优越性。

原文摘要 · Abstract (English)

With the rapid evolution of autonomous driving technology and intelligent transportation systems, semantic segmentation has become increasingly critical. Precise interpretation and analysis of real-world environments are indispensable for these advanced applications. However, traditional semantic segmentation approaches frequently face challenges in balancing model performance with computational efficiency, especially regarding the volume of model parameters. To address these constraints, we propose SegRet, a novel model employing the Retentive Network (RetNet) architecture coupled with a lightweight residual decoder that integrates zero-initialization. SegRet offers three distinctive advantages: (1) Lightweight Residual Decoder: by embedding a zero-initialization layer within the residual network structure, the decoder remains computationally streamlined without sacrificing essential information propagation; (2) Robust Feature Extraction: adopting RetNet as its backbone enables SegRet to effectively capture hierarchical image features, thereby enriching the representation quality of extracted features; (3) Parameter Efficiency: SegRet attains state-of-the-art (SOTA) segmentation performance while markedly decreasing the number of parameters, ensuring high accuracy without imposing additional computational burdens. Comprehensive empirical evaluations on prominent benchmarks, such as ADE20K, Citycapes, and COCO-Stuff, highlight the effectiveness and superiority of our method.

语义分割RetNet轻量模型自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。