arXiv:2601.08034cs.ROcs.CV2026-01

用单张图像实现机器人状态估计,无需复杂标定。

Fiducial Exoskeletons: Image-Centric Robot State Estimation

  • 单图直接估各关节6D位姿,通过轻量优化保持运动学一致性。
  • 使用带标记的3D打印外骨骼,单图即可获得精确位姿与关节角。
  • 适合低成本硬件、免标定场景,提升控制精度与部署效率。

我们提出Fiducial Exoskeletons,一种基于图像的3D机器人状态估计新范式,将传统依赖高精度执行器和繁琐手眼标定的流程,替换为单张图像推理。核心思想有两点:一是将机器人状态估计转化为从单张RGB图像中估计每个连杆的6D位姿,基座姿态由基连杆位姿直接获得,关节状态通过轻量级全局优化恢复,可选地以编码器读数作为初始值;二是引入“标识外骨骼”——每连杆上附着一个3D打印支架,带有已知几何关系的标识标记,使每连杆的SE(3)位姿估计鲁棒且简单,无需学习。该设计实现了相机-机器人外参、各连杆位姿及关节角的单图联合估计,即使在断电状态下仍能稳定工作。在低成本机械臂上验证,显著简化了系统搭建,提升了标定精度、状态估计准确率和下游3D控制性能。代码与可打印硬件设计均已开源,支持软硬协同设计。

原文摘要 · Abstract (English)

We introduce Fiducial Exoskeletons, an image-based reformulation of 3D robot state estimation that replaces cumbersome procedures and motor-centric pipelines with single-image inference. Traditional approaches - especially robot-camera extrinsic estimation - often rely on high-precision actuators and require time-consuming routines such as hand-eye calibration. In contrast, modern learning-based robot control is increasingly trained and deployed from RGB observations on lower-cost hardware. Our key insight is twofold. First, we cast robot state estimation as 6D pose estimation of each link from a single RGB image: the robot-camera base transform is obtained directly as the estimated base-link pose, and the joint state is recovered via a lightweight global optimization that enforces kinematic consistency with the observed link poses (optionally warm-started with encoder readings). Second, we make per-link 6D pose estimation robust and simple - even without learning - by introducing the fiducial exoskeleton: a lightweight 3D-printed mount with a fiducial marker on each link and known marker-link geometry. This design yields robust camera-robot extrinsics, per-link SE(3) poses, and joint-angle state from a single image, enabling robust state estimation even on unplugged robots. Demonstrated on a low-cost robot arm, fiducial exoskeletons substantially simplify setup while improving calibration, state accuracy, and downstream 3D control performance. We release code and printable hardware designs to enable further algorithm-hardware co-design.

状态估计单图像机器人外骨骼

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。