无需标记和训练,机器人自主完成相机与机械臂标定。
ARC-Calib: Autonomous Markerless Camera-to-Robot Calibration via Exploratory Robot Motions
- 通过探索性运动在图像中生成可追踪的轨迹模式。
- 利用共面与共线约束迭代优化标定结果,精度高且稳定。
- 适合边缘设备,适用于多种机器人和真实场景。
相机到机器人(即眼到手)标定是视觉引导机器人操作的关键环节。传统基于标记的方法通常需要人工设置。现有自主无标记标定方法多依赖预训练机器人跟踪模型,限制了其在边缘设备上的应用,且需为新机器人型号重新微调。为此,本文提出全自主、可泛化的无标记标定框架ARC-Calib,无需大量数据采集或模型训练。首先,通过探索性机器人运动在相机画面中生成易追踪的轨迹视觉模式;随后,设计几何优化框架,利用观测运动中的共面性和共线性约束,迭代优化标定结果。该方法无需额外环境标记或数据收集与模型训练,具备高度可移植性。在仿真与真实世界中进行了广泛实验,验证了其鲁棒性与泛化能力。
原文摘要 · Abstract (English)
Camera-to-robot (also known as eye-to-hand) calibration is a critical component of vision-based robot manipulation. Traditional marker-based methods often require human intervention for system setup. Furthermore, existing autonomous markerless calibration methods typically rely on pre-trained robot tracking models that impede their application on edge devices and require fine-tuning for novel robot embodiments. To address these limitations, this paper proposes a model-based markerless camera-to-robot calibration framework, ARC-Calib, that is fully autonomous and generalizable across diverse robots and scenarios without requiring extensive data collection or learning. First, exploratory robot motions are introduced to generate easily trackable trajectory-based visual patterns in the camera's image frames. Then, a geometric optimization framework is proposed to exploit the coplanarity and collinearity constraints from the observed motions to iteratively refine the estimated calibration result. Our approach eliminates the need for extra effort in either environmental marker setup or data collection and model training, rendering it highly adaptable across a wide range of real-world autonomous systems. Extensive experiments are conducted in both simulation and the real world to validate its robustness and generalizability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。