arXiv:2601.01438cs.ROcs.AI2026-01被引 2

用视觉先验+运动感知实时估算物体关节,让机器人能自动开门。

Online Estimation and Manipulation of Articulated Objects

  • 结合视觉预判与运动传感,用螺旋理论建模关节
  • 真实实验中对未知物体开门成功率75%
  • 适合想提升机器人抓取灵活性的研究者

从冰箱到厨房抽屉,人类每天都能轻松操作各种铰接物体完成家务。要实现这些任务的自动化,服务机器人必须具备操纵任意铰接物体的能力。近期深度学习方法已能从视觉中预测物体可操作性的有效先验。相比之下,许多其他工作通过观察运动来估计物体的铰接方式,但这要求机器人已具备操纵能力。本文提出一种新方法,将两者结合:利用因子图在线估计铰接结构,融合学习到的视觉先验与交互过程中的本体感觉(如运动与力),构建基于螺旋理论的解析模型。机器人在触碰前先通过视觉做出初始关节预测,随后在操作过程中快速更新估计。我们在仿真和真实机器人实验中广泛评估该方法,展示了多个闭环估计与操控实验,机器人成功打开此前未见过的抽屉。在真实硬件实验中,机器人对未知铰接物体实现了75%的自主开启成功率。

原文摘要 · Abstract (English)

From refrigerators to kitchen drawers, humans interact with articulated objects effortlessly every day while completing household chores. For automating these tasks, service robots must be capable of manipulating arbitrary articulated objects. Recent deep learning methods have been shown to predict valuable priors on the affordance of articulated objects from vision. In contrast, many other works estimate object articulations by observing the articulation motion, but this requires the robot to already be capable of manipulating the object. In this article, we propose a novel approach combining these methods by using a factor graph for online estimation of articulation which fuses learned visual priors and proprioceptive sensing during interaction into an analytical model of articulation based on Screw Theory. With our method, a robotic system makes an initial prediction of articulation from vision before touching the object, and then quickly updates the estimate from kinematic and force sensing during manipulation. We evaluate our method extensively in both simulations and real-world robotic manipulation experiments. We demonstrate several closed-loop estimation and manipulation experiments in which the robot was capable of opening previously unseen drawers. In real hardware experiments, the robot achieved a 75% success rate for autonomous opening of unknown articulated objects.

机器人操控关节估计视觉感知螺旋理论

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。