用双目视觉补足激光雷达短板,识别透明或无反射物体并估算其深度与尺寸
Object Depth and Size Estimation using Stereo-vision and Integration with SLAM
- 双目视觉检测结合简单机器学习,同时识别实体与非实体物体
- 在真实机器人上验证,对物体深度和尺寸估计精度高
- 适合需要复杂环境感知的自主导航机器人应用
自主机器人依靠同步定位与地图构建(SLAM)在各种环境中实现高效安全导航。激光雷达(LiDAR)在目标识别与定位中起关键作用,但对半透明或无形物体(如火焰、烟雾、蒸汽)因反射特性差而难以检测。此外,激光雷达也常无法识别路标等特征,且对缺乏明显反射表面的危险物质探测能力弱。本文提出一种高精度双目视觉方法,作为激光雷达的补充。系统采用先进的双目视觉目标检测技术,可识别实体与非实体物体,并通过简单机器学习精确估计物体的深度与尺寸。该信息被集成至SLAM流程中,提升机器人在复杂环境中的导航能力。实验在配备激光雷达与双目视觉系统的自主机器人上进行,验证了物体深度与尺寸估计的高准确性。方案演示视频见:\url{https://www.youtube.com/watch?v=nusI6tA9eSk}。
原文摘要 · Abstract (English)
Autonomous robots use simultaneous localization and mapping (SLAM) for efficient and safe navigation in various environments. LiDAR sensors are integral in these systems for object identification and localization. However, LiDAR systems though effective in detecting solid objects (e.g., trash bin, bottle, etc.), encounter limitations in identifying semitransparent or non-tangible objects (e.g., fire, smoke, steam, etc.) due to poor reflecting characteristics. Additionally, LiDAR also fails to detect features such as navigation signs and often struggles to detect certain hazardous materials that lack a distinct surface for effective laser reflection. In this paper, we propose a highly accurate stereo-vision approach to complement LiDAR in autonomous robots. The system employs advanced stereo vision-based object detection to detect both tangible and non-tangible objects and then uses simple machine learning to precisely estimate the depth and size of the object. The depth and size information is then integrated into the SLAM process to enhance the robot's navigation capabilities in complex environments. Our evaluation, conducted on an autonomous robot equipped with LiDAR and stereo-vision systems demonstrates high accuracy in the estimation of an object's depth and size. A video illustration of the proposed scheme is available at: \url{https://www.youtube.com/watch?v=nusI6tA9eSk}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。