用自动标注提升自行车平台3D检测,让自动驾驶更懂行人与骑行者。
Auto-Labelling-Based Domain Transfer for 3D Object Detection on a Bicycle-Mounted LiDAR Platform

- 基于自动标注生成无人工标注的训练数据,适配车辆模型到自行车视角。
- 微调后检测性能提升23.4点mAP,对行人和骑行者效果最显著。
- 首个自行车视角3D检测基准,适合关注弱势道路使用者感知的研究者。
可靠感知城市交通中的弱势道路使用者(如行人和骑行者)是保障其安全及实现自动驾驶的核心需求。随着研究将传感器搭载于自行车上以从使用者视角观察交通,现有基于车辆数据训练的激光雷达检测器在该场景下的泛化能力尚未评估。本文构建了基于慕尼黑FUSE-Bike平台的3D目标检测基准,包含1,027个标注激光雷达关键帧(超过18,000个3D边界框),并使用1,854个经人工验证的真实标签评估四个在nuScenes上预训练的检测器。通过一个无需人工标注的专为弱势道路使用者设计的自动标注流水线生成训练标签,微调后模型性能大幅提升,最高实现mAP提升23.4点,尤其在行人和骑行者类别上增益最大,且优化后的模型甚至优于其训练所用的自动标注质量。该基准为以弱势道路使用者为中心的3D检测提供可复现基线,证明自动标注可有效替代人工标注,实现模型迁移。
原文摘要 · Abstract (English)
Reliable 3D perception of vulnerable road users (VRUs) such as cyclists and pedestrians is essential for their safety in urban traffic and a core requirement for autonomous driving (AD). Alongside advances in vehicle-based perception, research increasingly equips bicycles with sensors to study traffic from a perspective native to VRUs. Such platforms still rely on LiDAR detectors originally trained on vehicle data, yet annotated 3D data from a cyclist's perspective is scarce. How well these detectors generalise to this setting has not been evaluated. We present a 3D object detection benchmark of 1,027 annotated LiDAR keyframes (over 18,000 3D bounding boxes) from the FUSE-Bike platform in urban Munich. We evaluate four nuScenes-pre-trained detectors against 1,854 human-verified ground-truth (GT) boxes both in their original form and after finetuning on training labels produced by a VRU-dedicated auto-labelling pipeline that requires no manual annotation. The zero-shot domain gap is concentrated on the VRU classes. Finetuning recovers most of it, improving mean average precision (mAP) by up to 23.4 points with the largest gains on pedestrians and cyclists, and the adapted detectors even surpass the quality of the auto-labels they were trained on. The benchmark provides a reproducible baseline for VRU-centric 3D detection and shows that auto-labels are a viable substitute for manual annotation when adapting vehicle-trained detectors to a cyclist platform.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。