arXiv:2502.02972cs.ROcs.LG2025-02ICRA被引 5

无需提示词,一键生成高精度语义标注,大幅降低自动驾驶数据标注成本。

Label Anything: An Interpretable, High-Fidelity and Prompt-Free Annotator

  • 基于预训练ViT与轻量级适配器,实现无需提示的自动标注。
  • 在Camvid、Cityscapes等数据集上达到接近100%的mIoU指标。
  • 仅需一张带标签的图像即可训练,适合大规模场景标注应用。

近年来,基于学习的自动驾驶街景语义理解取得显著进展,但模型性能高度依赖标注数据的数量与质量。传统人工标注成本高昂,难以满足大规模训练需求。为此,我们提出一种无需提示词的可解释、高保真标注模型(Label Anything Model, LAM)。首先利用预训练视觉变压器(ViT)提取特征,再通过轻量级语义类适配器(SCA)融合特征以支持自动标注;同时设计优化导向的展开算法(OptOU),采用多层级联优化结构,逐层逼近真实标签,具备可解释性而非黑箱学习。SCA与OptOU参数量极小,仅需一张预标注的RGB种子图像即可完成训练。大量实验表明,LAM在Camvid、Cityscapes、Apolloscapes及CARLA仿真数据集上均能生成高质量标注,平均mIoU接近100%。

原文摘要 · Abstract (English)

Learning-based street scene semantic understanding in autonomous driving (AD) has advanced significantly recently, but the performance of the AD model is heavily dependent on the quantity and quality of the annotated training data. However, traditional manual labeling involves high cost to annotate the vast amount of required data for training robust model. To mitigate this cost of manual labeling, we propose a Label Anything Model (denoted as LAM), serving as an interpretable, high-fidelity, and prompt-free data annotator. Specifically, we firstly incorporate a pretrained Vision Transformer (ViT) to extract the latent features. On top of ViT, we propose a semantic class adapter (SCA) and an optimization-oriented unrolling algorithm (OptOU), both with a quite small number of trainable parameters. SCA is proposed to fuse ViT-extracted features to consolidate the basis of the subsequent automatic annotation. OptOU consists of multiple cascading layers and each layer contains an optimization formulation to align its output with the ground truth as closely as possible, though which OptOU acts as being interpretable rather than learning-based blackbox nature. In addition, training SCA and OptOU requires only a single pre-annotated RGB seed image, owing to their small volume of learnable parameters. Extensive experiments clearly demonstrate that the proposed LAM can generate high-fidelity annotations (almost 100% in mIoU) for multiple real-world datasets (i.e., Camvid, Cityscapes, and Apolloscapes) and CARLA simulation dataset.

语义分割自动化标注可解释性ViT

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。