arXiv:2505.24819cs.ROcs.CV2025-05被引 1

无需标定板,双臂机器人通过视觉联合校准与建模。

Bi-Manual Joint Camera Calibration and Scene Representation

  • 利用3D基础模型实现无标记多视角对应匹配
  • 同步估计相机位姿、双臂相对姿态与统一3D场景表示
  • 适合需要双臂协同操作的机器人系统

机器人双臂操作通常需在多个机械臂上安装摄像头。在生成运动或构建环境表示前,必须对安装在机械臂上的摄像头进行标定。传统标定过程繁琐,需采集一系列包含预设标记物的图像。本文提出双臂联合校准与表征框架(Bi-JCR),使配备摄像头的多个机械臂无需拍摄标定板即可完成校准。通过利用3D基础模型实现密集、无标记的多视角对应,Bi-JCR 联合估计:(i) 每个相机到末端执行器的外参变换,(ii) 两机械臂间的相对位姿,以及 (iii) 共享工作空间的统一、尺度一致的3D表示。该表示由双臂摄像头共同捕捉的图像构建,位于同一坐标系中,支持碰撞检测与语义分割,可直接用于下游双臂协调任务。我们在多种桌面场景中评估了 Bi-JCR 的鲁棒性,并展示了其在多种下游任务中的适用性。

原文摘要 · Abstract (English)

Robot manipulation, especially bimanual manipulation, often requires setting up multiple cameras on multiple robot manipulators. Before robot manipulators can generate motion or even build representations of their environments, the cameras rigidly mounted to the robot need to be calibrated. Camera calibration is a cumbersome process involving collecting a set of images, with each capturing a pre-determined marker. In this work, we introduce the Bi-Manual Joint Calibration and Representation Framework (Bi-JCR). Bi-JCR enables multiple robot manipulators, each with cameras mounted, to circumvent taking images of calibration markers. By leveraging 3D foundation models for dense, marker-free multi-view correspondence, Bi-JCR jointly estimates: (i) the extrinsic transformation from each camera to its end-effector, (ii) the inter-arm relative poses between manipulators, and (iii) a unified, scale-consistent 3D representation of the shared workspace, all from the same captured RGB image sets. The representation, jointly constructed from images captured by cameras on both manipulators, lives in a common coordinate frame and supports collision checking and semantic segmentation to facilitate downstream bimanual coordination tasks. We empirically evaluate the robustness of Bi-JCR on a variety of tabletop environments, and demonstrate its applicability on a variety of downstream tasks.

双臂协作相机标定3D重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。