用少量标注或无标注实现自动驾驶运动预测,降低人工成本。
Weakly and Self-Supervised Class-Agnostic Motion Prediction for Autonomous Driving
- 用前景/背景掩码替代运动标注,仅需1%甚至0.01%标注数据
- 提出新损失函数,在自监督下提升对异常值的鲁棒性
- 无需人工标注的模型性能接近有监督方法,适合真实场景部署
理解动态环境中的运动对自动驾驶至关重要,推动了无类别运动预测的研究。本文研究从激光雷达点云中进行弱监督和自监督的无类别运动预测。室外场景通常包含移动前景和静态背景,使运动理解与场景解析相关联。基于此,我们提出一种新型弱监督范式,用全量或部分标注(1%、0.1%)的前景/背景掩码替代运动标注。为此,我们开发了一种利用前景/背景线索指导自监督学习运动预测模型的方法。由于前景运动多发生在非地面区域,可用非地面/地面掩码替代前景/背景掩码,进一步减少标注负担。在此基础上,我们提出两种额外方法:一种仅需0.01%前景/背景标注的弱监督方法,以及一种完全无标注的自监督方法。此外,我们设计了一种鲁棒的一致性感知切比雪夫距离损失,结合多帧信息与鲁棒惩罚函数,有效抑制自监督学习中的异常值。实验表明,我们的弱监督与自监督模型优于现有自监督方法,且弱监督模型性能接近部分有监督模型,证明所提方法能有效平衡标注成本与性能。
原文摘要 · Abstract (English)
Understanding motion in dynamic environments is critical for autonomous driving, thereby motivating research on class-agnostic motion prediction. In this work, we investigate weakly and self-supervised class-agnostic motion prediction from LiDAR point clouds. Outdoor scenes typically consist of mobile foregrounds and static backgrounds, allowing motion understanding to be associated with scene parsing. Based on this observation, we propose a novel weakly supervised paradigm that replaces motion annotations with fully or partially annotated (1%, 0.1%) foreground/background masks for supervision. To this end, we develop a weakly supervised approach utilizing foreground/background cues to guide the self-supervised learning of motion prediction models. Since foreground motion generally occurs in non-ground regions, non-ground/ground masks can serve as an alternative to foreground/background masks, further reducing annotation effort. Leveraging non-ground/ground cues, we propose two additional approaches: a weakly supervised method requiring fewer (0.01%) foreground/background annotations, and a self-supervised method without annotations. Furthermore, we design a Robust Consistency-aware Chamfer Distance loss that incorporates multi-frame information and robust penalty functions to suppress outliers in self-supervised learning. Experiments show that our weakly and self-supervised models outperform existing self-supervised counterparts, and our weakly supervised models even rival some supervised ones. This demonstrates that our approaches effectively balance annotation effort and performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。