让人形机器人稳定抓物行走,靠根轨迹统一控制导航与操作
Pro-HOI: Perceptive Root-guided Humanoid-Object Interaction
- 用根轨迹作为通用接口,端到端控制行走与抓取
- 实测在真实环境完成长时间复杂任务,成功率显著提升
- 融合数字孪生实时检测滑落,自动触发重抓动作
人形机器人执行可靠的人-物交互任务,受限于缺乏泛化控制接口和鲁棒闭环感知机制。本文提出普适性框架 Pro-HOI,实现稳健的人形动觉操作。首先,收集适合实际部署的搬箱动作,并通过符号距离场损失优化穿透伪影。其次,提出新型训练框架:以期望根轨迹为策略条件,仅用参考动作为奖励,既免去复杂奖励调参,又将根轨迹作为高层规划的通用接口,实现导航与动觉操作同步。此外,为保障运行可靠性,引入持续物体估计模块,融合实时检测与数字孪生,使机器人可自主检测滑落并触发重抓。在 Unitree G1 机器人上的实证验证表明,Pro-HOI 在泛化性和鲁棒性上显著优于基线,在复杂真实场景中实现可靠的长时程执行。
原文摘要 · Abstract (English)
Executing reliable Humanoid-Object Interaction (HOI) tasks for humanoid robots is hindered by the lack of generalized control interfaces and robust closed-loop perception mechanisms. In this work, we introduce Perceptive Root-guided Humanoid-Object Interaction, Pro-HOI, a generalizable framework for robust humanoid loco-manipulation. First, we collect box-carrying motions that are suitable for real-world deployment and optimize penetration artifacts through a Signed Distance Field loss. Second, we propose a novel training framework that conditions the policy on a desired root-trajectory while utilizing reference motion exclusively as a reward. This design not only eliminates the need for intricate reward tuning but also establishes root trajectory as a universal interface for high-level planners, enabling simultaneous navigation and loco-manipulation. Furthermore, to ensure operational reliability, we incorporate a persistent object estimation module. By fusing real-time detection with Digital Twin, this module allows the robot to autonomously detect slippage and trigger re-grasping maneuvers. Empirical validation on a Unitree G1 robot demonstrates that Pro-HOI significantly outperforms baselines in generalization and robustness, achieving reliable long-horizon execution in complex real-world scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。