arXiv:2504.14113cs.CV2025-04被引 2

用向量量化提升自动驾驶道路分割效率,模型更轻、精度更高。

Lightweight Road Environment Segmentation using Vector Quantization

  • 用向量量化将连续特征转为离散码本向量,增强特征可解释性。
  • 在Cityscapes上达77.0% mIoU,比基线高2.9%,不增加模型大小。
  • 适合资源受限场景下的轻量级道路语义分割应用。

道路环境分割在自动驾驶中至关重要。现有基于全卷积网络(FCNs)和Transformer的方法依赖于从图像中提取连续表征,限制了对有意义离散信息的表达。为此,本文提出使用向量量化进行自动驾驶环境分割。向量量化具备三大优势:(1)将编码器输出的连续特征映射至码本中的离散向量,使模型更易发现显著特征;(2)离散特征作为连续特征的压缩版本,可抑制噪声或异常值,提升分割性能;(3)促使潜在空间形成粗粒度聚类,强制模型对相似特征分组,使学习表征更具结构化,利于解码。本文将向量量化与轻量级模型MobileUNETR结合,作为对比基线。实验表明,在Cityscapes数据集上达到77.0% mIoU,较基线提升2.9%,且未增加模型初始规模或复杂度。

原文摘要 · Abstract (English)

Road environment segmentation plays a significant role in autonomous driving. Numerous works based on Fully Convolutional Networks (FCNs) and Transformer architectures have been proposed to leverage local and global contextual learning for efficient and accurate semantic segmentation. In both architectures, the encoder often relies heavily on extracting continuous representations from the image, which limits the ability to represent meaningful discrete information. To address this limitation, we propose segmentation of the autonomous driving environment using vector quantization. Vector quantization offers three primary advantages for road environment segmentation. (1) Each continuous feature from the encoder is mapped to a discrete vector from the codebook, helping the model discover distinct features more easily than with complex continuous features. (2) Since a discrete feature acts as compressed versions of the encoder's continuous features, they also compress noise or outliers, enhancing the image segmentation task. (3) Vector quantization encourages the latent space to form coarse clusters of continuous features, forcing the model to group similar features, making the learned representations more structured for the decoding process. In this work, we combined vector quantization with the lightweight image segmentation model MobileUNETR and used it as a baseline model for comparison to demonstrate its efficiency. Through experiments, we achieved 77.0 % mIoU on Cityscapes, outperforming the baseline by 2.9 % without increasing the model's initial size or complexity.

道路分割向量量化轻量模型自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。