对比四款立体深度相机,实测其在机器人场景下的精度与适用性。
Empirical Comparison of Four Stereoscopic Depth Sensing Cameras for Robotics Applications
- 基于双目视差原理,实测四款相机在三种场景下的深度表现。
- D435在1米内误差<1厘米,适合桌面机器人;ZED 2在4米内误差<3厘米最佳。
- 数据集公开,适合移动机器人或需嵌入AI的场景选择相机。
深度感知是机器人等领域关键技术。本文实测四款基于双目视差的RGB-D相机(Intel RealSense D435、D455,StereoLabs ZED 2,Luxonis OAK-D Pro),在三个场景中评估:平面感知、塑料娃娃感知、家用物体感知(YCB数据集)。每台相机采集并评估超过3,000帧RGB-D图像。对于距离物体不超过1米的桌面机器人应用,D435表现最优,所有场景误差均低于1厘米。在更远距离下,其余三款表现更佳,更适合移动机器人。OAK-D Pro集成AI模块(如目标与人体关键点检测)。ZED 2整体最佳,即使在4米距离仍能保持误差低于3厘米,但需搭配带GPU的计算机使用。全部数据(超12,000帧RGB-D)已公开于https://rustlluk.github.io/rgbd-comparison。
原文摘要 · Abstract (English)
Depth sensing is an essential technology in robotics and many other fields. Many depth sensing (or RGB-D) cameras are available on the market and selecting the best one for your application can be challenging. In this work, we tested four stereoscopic RGB-D cameras that sense the distance by using two images from slightly different views. We empirically compared four cameras (Intel RealSense D435, Intel RealSense D455, StereoLabs ZED 2, and Luxonis OAK-D Pro) in three scenarios: (i) planar surface perception, (ii) plastic doll perception, (iii) household object perception (YCB dataset). We recorded and evaluated more than 3,000 RGB-D frames for each camera. For table-top robotics scenarios with distance to objects up to one meter, the best performance is provided by the D435 camera that is able to perceive with an error under 1 cm in all of the tested scenarios. For longer distances, the other three models perform better, making them more suitable for some mobile robotics applications. OAK-D Pro additionally offers integrated AI modules (e.g., object and human keypoint detection). ZED 2 is overall the best camera which is able to keep the error under 3 cm even at 4 meters. However, it is not a standalone device and requires a computer with a GPU for depth data acquisition. All data (more than 12,000 RGB-D frames) are publicly available at https://rustlluk.github.io/rgbd-comparison.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。