arXiv:2501.07133cs.CV2025-01

提出首个激光雷达3D跟踪恶劣天气基准,揭示现有方法失效原因并设计新框架。

Robust Single Object Tracking in LiDAR Point Clouds under Adverse Weather Conditions

  • 构建雨/雾/雪三类合成与真实数据集,评估3D跟踪鲁棒性。
  • 实测主流追踪器在恶劣天气下性能大幅下降,平均精度损失超40%。
  • 从距离、模板形变、目标形变三方面分析失败机制,适配自动驾驶场景。

激光雷达点云中的3D单目标跟踪(3DSOT)是户外感知的关键任务,可实现对目标位置、朝向和运动的实时感知。尽管当前3DSOT方法表现优异,但仅在干净数据集上评估难以全面反映其真实性能,因实际环境中恶劣天气未被充分考虑。主要障碍在于缺乏针对3DSOT的恶劣天气评估基准。为此,本文提出一个具有挑战性的激光雷达3D跟踪恶劣天气基准,包含两个合成数据集(KITTI-A 和 nuScenes-A)以及一个真实数据集(CADC-SOT),覆盖雨、雾、雪三种天气类型。基于该基准,五种来自不同追踪框架的代表性3D追踪器进行了鲁棒性评估,结果出现显著性能下降。这引发关键问题:为何当前先进方法在恶劣天气样本中失效?我们从三个角度展开分析:1)目标距离;2)模板形状退化;3)目标形状退化。最终,基于领域随机化与对比学习,设计了双分支追踪框架DRCT,在多个基准上取得优异表现。

原文摘要 · Abstract (English)

3D single object tracking (3DSOT) in LiDAR point clouds is a critical task for outdoor perception, enabling real-time perception of object location, orientation, and motion. Despite the impressive performance of current 3DSOT methods, evaluating them on clean datasets inadequately reflects their comprehensive performance, as the adverse weather conditions in real-world surroundings has not been considered. One of the main obstacles is the lack of adverse weather benchmarks for the evaluation of 3DSOT. To this end, this work proposes a challenging benchmark for LiDAR-based 3DSOT in adverse weather, which comprises two synthetic datasets (KITTI-A and nuScenes-A) and one real-world dataset (CADC-SOT) spanning three weather types: rain, fog, and snow. Based on this benchmark, five representative 3D trackers from different tracking frameworks conducted robustness evaluation, resulting in significant performance degradations. This prompts the question: What are the factors that cause current advanced methods to fail on such adverse weather samples? Consequently, we explore the impacts of adverse weather and answer the above question from three perspectives: 1) target distance; 2) template shape corruption; and 3) target shape corruption. Finally, based on domain randomization and contrastive learning, we designed a dual-branch tracking framework for adverse weather, named DRCT, achieving excellent performance in benchmarks.

3D跟踪激光雷达恶劣天气鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。