用自监督预训练减少标注数据,提升细粒度鸟瞰图分割性能。
Faster Training, Fewer Labels: Self-Supervised Pretraining for Fine-Grained BEV Segmentation
- 通过可微重投影将BEV预测映射回图像,生成伪标签进行自监督训练。
- 微调阶段仅需50%数据,训练时间减少三分之二,精度提升2.5个百分点。
- 适合追求低标注成本与高效训练的自动驾驶感知系统开发者。
稠密鸟瞰图(BEV)语义地图是自动驾驶的核心,但现有多摄像头方法依赖昂贵且不一致的BEV真值标注。本文提出两阶段训练策略,实现细粒度道路标记分割:预训练阶段完全无需全监督,微调阶段仅需50%数据量,仍优于全监督基线模型。自监督预训练中,将BEVFormer的预测可微重投影至图像平面,与由广泛使用的Mask2Former生成的多视图语义伪标签对齐,并引入时序一致性损失。后续监督微调仅需一半数据集,显著缩短训练时间。该方法使微调受益于预训练中学习到的丰富先验,提升nuScenes数据集上的分割质量(最高达+2.5pp mIoU),同时将标注数据使用量减半,总训练时间最多减少三分之二。结果表明,可微重投影结合相机视角伪标签能生成可迁移的BEV特征,为低标签依赖自动驾驶感知提供可扩展路径。
原文摘要 · Abstract (English)
Dense Bird's Eye View (BEV) semantic maps are central to autonomous driving, yet current multi-camera methods depend on costly, inconsistently annotated BEV ground truth. We address this limitation with a two-phase training strategy for fine-grained road marking segmentation that removes full supervision during pretraining and halves the amount of training data during fine-tuning while still outperforming the comparable supervised baseline model. During the self-supervised pretraining, BEVFormer predictions are differentiably reprojected into the image plane and trained against multi-view semantic pseudo-labels generated by the widely used semantic segmentation model Mask2Former. A temporal loss encourages consistency across frames. The subsequent supervised fine-tuning phase requires only 50% of the dataset and significantly less training time. With our method, the fine-tuning benefits from rich priors learned during pretraining boosting the performance and BEV segmentation quality (up to +2.5pp mIoU over the fully supervised baseline) on nuScenes. It simultaneously halves the usage of annotation data and reduces total training time by up to two thirds. The results demonstrate that differentiable reprojection plus camera perspective pseudo labels yields transferable BEV features and a scalable path toward reduced-label autonomous perception.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。