arXiv:2604.20169cs.CV2026-04被引 1

用快版SAM实现实时高精度语义分割,适合机器人等实时场景。

Semantic-Fast-SAM: Efficient Semantic Segmenter

论文配图:Semantic-Fast-SAM: Efficient Semantic Segmenter
图 1 · 摘自论文原文
  • 基于FastSAM快速生成掩码,再通过语义标注策略分配类别。
  • 在Cityscapes和ADE20K上达mIoU 70.33和48.01,推理速度提升20倍。
  • 支持开放词汇分割,适合需要实时性与泛化能力的系统部署。

我们提出Semantic-Fast-SAM(SFS),一种结合FastSAM与语义标注流程的语义分割框架,在不损失准确率的前提下实现近实时性能。FastSAM是SAM的高效CNN重实现,比原版Transformer结构快得多。在FastSAM快速生成掩码的基础上,我们引入语义-分割一切(SSA)标注策略,为每个掩码分配有意义的类别。SFS在计算成本和内存占用上远低于原始SAM方案,且在Cityscapes和ADE20K基准上分别达到约70.33和48.01的mIoU。在封闭集设置下,推理速度比SSA快约20倍。此外,通过CLIP-based语义头,SFS有效处理开放词汇分割任务,在广泛类别标注上优于近期模型。该工作使具备‘分割一切’能力的基座分割模型可应用于机器人等实时场景。代码已开源:https://github.com/KBH00/Semantic-Fast-SAM。

原文摘要 · Abstract (English)

We propose Semantic-Fast-SAM (SFS), a semantic segmentation framework that combines the Fast Segment Anything model with a semantic labeling pipeline to achieve real-time performance without sacrificing accuracy. FastSAM is an efficient CNN-based re-implementation of the Segment Anything Model (SAM) that runs much faster than the original transformer-based SAM. Building upon FastSAM's rapid mask generation, we integrate a Semantic-Segment-Anything (SSA) labeling strategy to assign meaningful categories to each mask. The resulting SFS model produces high-quality semantic segmentation maps at a fraction of the computational cost and memory footprint of the original SAM-based approach. Experiments on Cityscapes and ADE20K benchmarks demonstrate that SFS matches the accuracy of prior SAM-based methods (mIoU ~ 70.33 on Cityscapes and 48.01 on ADE20K) while achieving approximately 20x faster inference than SSA in the closed-set setting. We also show that SFS effectively handles open-vocabulary segmentation by leveraging CLIP-based semantic heads, outperforming recent open-vocabulary models on broad class labeling. This work enables practical real-time semantic segmentation with the "segment-anything" capability, broadening the applicability of foundation segmentation models in robotics scenarios. The implementation is available at https://github.com/KBH00/Semantic-Fast-SAM.

语义分割实时推理SAM开放词汇

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。