统一训练多传感器激光雷达场景流,零样本迁移效果显著。
UniFlow: Zero-Shot LiDAR Scene Flow for Autonomous Vehicles
- 用多数据集联合训练,无需修改架构即可提升泛化能力。
- 在Waymo和nuScenes上分别提升5.1%和35.2%准确率。
- 对未见过的传感器数据表现优异,适合实际自动驾驶部署。
激光雷达场景流旨在估计连续点云间每点的三维运动。现有方法在主流自动驾驶数据集上达到厘米级精度,但通常仅在单一传感器上训练与评估。本文旨在学习可迁移至多样化未见激光雷达传感器的通用运动先验。以往研究在语义分割与3D目标检测中表明,跨数据集训练会降低性能,但我们在运动估计任务中发现此规律不成立:最先进的场景流方法通过跨数据集训练显著受益,且无需架构调整。我们分析认为低层运动估计对传感器配置不敏感;例如,在高速道路数据集上训练的模型,仍能良好处理高速运动物体,即使跨数据集亦然。基于此,我们提出UniFlow——一个前馈模型,统一训练多个大规模、传感器配置与点云密度各异的激光雷达场景流数据集。该简单方案在Waymo和nuScenes上分别实现5.1%和35.2%的性能提升,创下新纪录;并在未知数据集TruckScenes和AEVAScenes上分别优于先前专用模型30.1%和22.5%。
原文摘要 · Abstract (English)
LiDAR scene flow is the task of estimating per-point 3D motion between consecutive point clouds. Recent methods achieve centimeter-level accuracy on popular autonomous vehicle (AV) datasets, but are typically only trained and evaluated on a single sensor. In this paper, we aim to learn general motion priors that transfer to diverse and unseen LiDAR sensors. However, prior work in LiDAR semantic segmentation and 3D object detection demonstrate that naively training on multiple datasets yields worse performance than single dataset models. Interestingly, we find that this conventional wisdom does not hold for motion estimation, and that state-of-the-art scene flow methods greatly benefit from cross-dataset training without architectural modification. We posit that low-level tasks such as motion estimation may be less sensitive to sensor configuration; indeed, our analysis shows that models trained on fast-moving objects (e.g., from highway datasets) perform well on fast-moving objects, even across different datasets. Informed by our analysis, we propose UniFlow, a feedforward model that unifies and trains on multiple large-scale LiDAR scene flow datasets with diverse sensor placements and point cloud densities. Our frustratingly simple solution establishes a new state-of-the-art on Waymo and nuScenes, improving over prior work by 5.1% and 35.2% respectively. Moreover, UniFlow achieves state-of-the-art accuracy on unseen datasets like TruckScenes and AEVAScenes, outperforming prior dataset-specific models by 30.1% and 22.5% respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。