用双目RGB-D相机实现机器人端到端视觉对接,无需初始位置限制。
DVDP: An End-to-End Policy for Mobile Robot Visual Docking with RGB-D Perception
- 直接从视觉输入生成对接路径,端到端设计免去传统分步处理。
- 在真实SCOUT Mini上验证,轨迹平滑且满足物理约束,成功率达100%。
- 自建大规模虚实结合数据集,支持高效评估与对比实验。
自动对接是移动机器人领域的长期挑战。相比其他方法,视觉对接精度更高、部署成本更低,更具应用前景。但现有视觉方法对机器人起始位置要求严格。为此,我们提出一种名为DVDP(直接视觉对接策略)的端到端视觉对接方法,仅需安装在机器人上的双目RGB-D相机,即可直接输出对接路径,实现端到端自动对接。同时,通过Unity 3D平台与实际机器人系统结合,构建了一个大规模移动机器人视觉自动对接数据集。我们设计了一系列评估指标以量化端到端对接方法性能。大量实验表明,该方法在多个感知主干网络适配下均表现优异。最终,在SCOUT Mini机器人上真实部署验证,模型生成的轨迹平滑可行,完全满足物理约束,成功完成对接任务。
原文摘要 · Abstract (English)
Automatic docking has long been a significant challenge in the field of mobile robotics. Compared to other automatic docking methods, visual docking methods offer higher precision and lower deployment costs, making them an efficient and promising choice for this task. However, visual docking methods impose strict requirements on the robot's initial position at the start of the docking process. To overcome the limitations of current vision-based methods, we propose an innovative end-to-end visual docking method named DVDP(direct visual docking policy). This approach requires only a binocular RGB-D camera installed on the mobile robot to directly output the robot's docking path, achieving end-to-end automatic docking. Furthermore, we have collected a large-scale dataset of mobile robot visual automatic docking dataset through a combination of virtual and real environments using the Unity 3D platform and actual mobile robot setups. We developed a series of evaluation metrics to quantify the performance of the end-to-end visual docking method. Extensive experiments, including benchmarks against leading perception backbones adapted into our framework, demonstrate that our method achieves superior performance. Finally, real-world deployment on the SCOUT Mini confirmed DVDP's efficacy, with our model generating smooth, feasible docking trajectories that meet physical constraints and reach the target pose.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。