用几何约束修复遮挡下的机械臂深度,提升遥操作精度
Seeing Through Occlusion: Deterministic Arm Kinematic Correction for Robot Teleoperation

- 基于手臂长度恒定,用勾股定理确定性推算被遮挡关节深度
- 在静态与动态动作下,RMSE低于12.3mm,相关系数超0.97
- 无需调参,适合实时遥操作与人机交互场景
无标记单RGB-D相机运动捕捉为机器人遥操作提供了低成本、非侵入式替代方案,但在上肢运动时自遮挡常导致深度估计退化。本文提出一种臂部运动学修正(AKC)方法,通过保持手臂长度恒定的几何约束来改善深度估计。该方法利用腕部位置和预设臂长,基于勾股定理进行确定性建模,避免复杂的概率建模与参数调优。实验对比Vicon参考系统,在静态与动态关节运动下均表现可靠,评估指标包括均方根误差(RMSE)与皮尔逊相关系数。同时,在仿真与物理机器人环境中成功实现了运动映射遥操作。结果表明,即使在长时间严重自遮挡及较弱时间滤波条件下,AKC仍能增强鲁棒性并保持解剖一致性,凸显其在机器人遥操作与人机交互中的实用性。
原文摘要 · Abstract (English)
Markerless, single-RGB-D-camera motion capture provides a low-cost and non-invasive alternative to conventional marker-based systems for robot teleoperation; however, depth estimation often degrades in the presence of self-occlusion, particularly during upper-limb motion. This paper presents an Arm Kinematic Correction (AKC) method that improves depth estimation by enforcing geometric constraints based on constant arm lengths. The proposed approach reconstructs occluded joint depths by leveraging wrist positions and predefined arm lengths via a deterministic formulation based on the Pythagorean theorem, thereby avoiding the need for complex probabilistic modeling or parameter tuning. Experimental validation against a Vicon reference system demonstrates reliable performance for both static and dynamic joint motions, evaluated using root-mean-square error (RMSE) and Pearson correlation. Furthermore, motion-mapping teleoperation is successfully demonstrated in both simulated and physical robot environments. The results show that AKC enhances robustness and preserves anatomical consistency under long-duration, severe self-occlusion, even when paired with less reliable temporal filters, highlighting its practicality for real-time applications such as robot teleoperation and human-robot interaction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。