让机器人用视觉感知推未知物体到任意位置,抗干扰能力强。
VOFA: Visual Object Goal Pushing with Force-Adaptive Control for Humanoids

- 分两层控制:高层视觉策略生成目标指令,底层力适应控制器抗扰动。
- 仿真成功率超90%,真实世界超80%,能推重达17kg的物体。
- 适合需要精准推物的人形机器人任务,如仓库搬运。
humanoid机器人在仓库等场景中执行物料搬运等复杂任务时,需具备利用机载视点感知,以目标导向方式推动大型物体的能力。为鲁棒地将重物推至任意目标位姿,机器人必须应对未知物体质量、地面摩擦、机载感知噪声及执行误差,并在实时反馈回路中协同处理。现有方案或依赖特权状态信息而无需机载感知,或对目标配置与物体物理属性变化缺乏鲁棒性。本文提出VOFA,一种视觉引导的人形机器人运动-操作系统,可将具有未知物理属性的物体推至任意目标位置。VOFA采用两级分层架构:高层视觉运动策略处理噪声观测并生成闭环目标指令,覆盖多种物体-目标组合;低层全肢体力适应控制器增强对物体物理属性变化的鲁棒性。系统在Booster T1人形机器人上进行了仿真与真实实验验证,结果表明:仿真成功率超过90%,真实实验成功率超过80%;且成功推动最重达17kg的物体,超过Booster T1自身重量的一半。
原文摘要 · Abstract (English)
The ability to push large objects in a goal-directed manner using onboard egocentric perception is an essential skill for humanoid robots to perform complex tasks such as material handling in warehouses. To robustly manipulate heavy objects to arbitrary goal configurations, the robot must cope with unknown object mass and ground friction, noisy onboard perception, and actuation errors; all in a real-time feedback loop. Existing solutions either rely on privileged object-state information without onboard perception or lack robustness to variations in goal configurations and object physical properties. In this work, we present VOFA, a visual goal-conditioned humanoid loco-manipulation system capable of pushing objects with unknown physical properties to arbitrary goal positions. VOFA consists of a two-level hierarchical architecture with a high-level visuomotor policy and a low-level force-adaptive whole-body controller. The high-level policy processes noisy onboard observations and generates goal-conditioned commands to operate in closed loop across diverse object-goal configurations, while the low-level whole-body controller provides robustness to variations in object physical properties. VOFA is extensively evaluated in both simulation and real-world experiments on the Booster T1 humanoid robot. Our results demonstrate strong performance, achieving over 90% success in simulation and over 80% success in real-world trials. Moreover, VOFA successfully pushes objects weighing up to 17kg, exceeding half of the Booster T1's body weight.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。