融合鱼眼相机与激光雷达,实现工地动态物体实时检测跟踪
Dynamic Object Detection and Tracking in Construction: A Fisheye Camera and LiDAR Sensor Fusion Model
- 用激光雷达点云结合鱼眼图像投影,实现3D运动目标检测
- 通过卡尔曼滤波更新,精准追踪物体在动/静状态间的切换
- 适合部署于复杂工地环境,系统简洁且鲁棒性强
在建筑工地等复杂环境中,机器人需安全高效地与人类协同作业,动态物体的鲁棒检测与跟踪至关重要。尽管基于激光雷达的SLAM和占用栅格方法可有效识别运动目标,但许多先进的3D视觉方法依赖预训练神经网络,并需额外后处理来判断运动状态。融合激光雷达的高精度与彩色图像的语义信息,是可行替代方案。本文提出一种新框架,用于配备激光雷达与向上视角鱼眼相机的四足机器人,在实时环境下实现动态物体检测与跟踪。首先在配准后的点云中识别运动物体,再将3D坐标投影至2D柱状全景图,与实时图像检测结果对齐,用于卡尔曼滤波的状态更新。该系统在处理物体在动态与静态间切换时表现优异,具备高精度、简单性与强鲁棒性,适用于真实建筑场景部署。
原文摘要 · Abstract (English)
Robust dynamic object detection and tracking are essential for enabling robots to operate safely and effectively alongside humans in complex environments such as construction sites. While LiDAR-based SLAM and occupancy grid methods offer viable solutions for detecting and tracking motion, many state-of-the-art 3D vision approaches rely heavily on pre-trained neural networks and require additional post-processing to identify moving objects. Sensor fusion techniques, combining the precision of LiDAR with the semantic richness of RGB imagery, offer a promising alternative. In this work, we present a novel framework that enhances a quadruped robot equipped with a LiDAR sensor and an upward-facing fisheye camera for real-time dynamic object detection and tracking. After identifying moving objects within a registered point cloud, our method assigns semantic labels by projecting 3D coordinates onto a 2D cylindrical panorama, aligning with real-time image-based detections for observation update of the Kalman filter. The proposed system demonstrates high precision, simplicity, and robustness, particularly in handling objects transitioning between dynamic and static states, thus it is well-suited for deployment in real-world construction environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。