融合摄像头与激光雷达,实现轻量化动态障碍物检测与跟踪
LV-DOT: LiDAR-visual dynamic obstacle detection and tracking for autonomous robot navigation
- 双传感器融合提升感知精度,兼顾实时性
- 在真实四旋翼上验证,定位误差低于15cm
- 适合资源受限的室内机器人导航应用
准确感知动态障碍物对室内自主机器人导航至关重要。尽管计算机视觉和自动驾驶领域已发展出复杂的3D目标检测与跟踪方法,但其对昂贵高精度传感器和大型神经网络带来的高算力需求,使其难以适用于室内机器人。近年来,基于机载摄像头或激光雷达的轻量级感知算法成为有前景的替代方案。然而,单一传感器存在明显局限:摄像头视场有限且易受噪声干扰,激光雷达采样频率低且缺乏视觉特征丰富性。为此,本文提出一种结合机载相机与激光雷达数据的动态障碍物检测与跟踪框架,实现轻量化且高精度感知。方法基于先前的集成检测思路,通过融合多个低精度但高效检测器的输出以保证机载计算平台上的实时性能。本工作进一步设计更鲁棒的融合策略,联合使用激光雷达与视觉数据提升检测精度。随后采用基于特征的对象关联与卡尔曼滤波的追踪模块,估计障碍物状态。此外,还设计了动态障碍物分类算法以可靠识别运动物体。数据集评估表明,相比基准方法,本方法具有更优的感知性能;在四旋翼机器人上的物理实验也证实了其在真实场景中导航的可行性。
原文摘要 · Abstract (English)
Accurate perception of dynamic obstacles is essential for autonomous robot navigation in indoor environments. Although sophisticated 3D object detection and tracking methods have been investigated and developed thoroughly in the fields of computer vision and autonomous driving, their demands on expensive and high-accuracy sensor setups and substantial computational resources from large neural networks make them unsuitable for indoor robotics. Recently, more lightweight perception algorithms leveraging onboard cameras or LiDAR sensors have emerged as promising alternatives. However, relying on a single sensor poses significant limitations: cameras have limited fields of view and can suffer from high noise, whereas LiDAR sensors operate at lower frequencies and lack the richness of visual features. To address this limitation, we propose a dynamic obstacle detection and tracking framework that uses both onboard camera and LiDAR data to enable lightweight and accurate perception. Our proposed method expands on our previous ensemble detection approach, which integrates outputs from multiple low-accuracy but computationally efficient detectors to ensure real-time performance on the onboard computer. In this work, we propose a more robust fusion strategy that integrates both LiDAR and visual data to enhance detection accuracy further. We then utilize a tracking module that adopts feature-based object association and the Kalman filter to track and estimate detected obstacles' states. Besides, a dynamic obstacle classification algorithm is designed to robustly identify moving objects. The dataset evaluation demonstrates a better perception performance compared to benchmark methods. The physical experiments on a quadcopter robot confirms the feasibility for real-world navigation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。