arXiv:2505.06776cs.RO2025-05被引 93

FALCON让机器人在推拉等力作用下仍能稳定行走并精准操作。

FALCON: Learning Force-Adaptive Humanoid Loco-Manipulation

  • 分上下身双智能体,分别负责稳走和精准抓握,自动适应外力。
  • 真实世界测试中实现0-100N推拉力下的稳定操作,关节跟踪精度提升2倍。
  • 一套训练策略适配多款机器人,无需重新调参,适合工业服务场景。

人形机器人进行全身协同的移动操作具有变革性潜力,但实现3D末端执行器受力下的精确、鲁棒控制仍是重大挑战。以往方法多局限于轻量任务或四足/轮式平台。为此,我们提出FALCON,一种基于双智能体强化学习的鲁棒力自适应人形移动操作框架。FALCON将全身控制分解为两个专用智能体:(1) 下半身智能体在外部力干扰下保持稳定行走;(2) 上半身智能体在隐式自适应力补偿下精确追踪末端位置。两者在模拟环境中联合训练,采用逐步增强末端执行器受力大小的力课程,同时遵守扭矩限制。实验表明,相较于基线方法,FALCON实现上半身关节跟踪精度提升2倍,且在力扰动下仍保持鲁棒行走,并实现更快训练收敛。此外,FALCON可在不进行特定机体奖励或课程调整的情况下完成策略训练。使用相同训练设置,我们获得可在多款人形机器人上部署的策略,成功实现真实世界中的载重运输(0–20N)、推车(0–100N)和开门(0–40N)等强力操作任务。

原文摘要 · Abstract (English)

Humanoid loco-manipulation holds transformative potential for daily service and industrial tasks, yet achieving precise, robust whole-body control with 3D end-effector force interaction remains a major challenge. Prior approaches are often limited to lightweight tasks or quadrupedal/wheeled platforms. To overcome these limitations, we propose FALCON, a dual-agent reinforcement-learning-based framework for robust force-adaptive humanoid loco-manipulation. FALCON decomposes whole-body control into two specialized agents: (1) a lower-body agent ensuring stable locomotion under external force disturbances, and (2) an upper-body agent precisely tracking end-effector positions with implicit adaptive force compensation. These two agents are jointly trained in simulation with a force curriculum that progressively escalates the magnitude of external force exerted on the end effector while respecting torque limits. Experiments demonstrate that, compared to the baselines, FALCON achieves 2x more accurate upper-body joint tracking, while maintaining robust locomotion under force disturbances and achieving faster training convergence. Moreover, FALCON enables policy training without embodiment-specific reward or curriculum tuning. Using the same training setup, we obtain policies that are deployed across multiple humanoids, enabling forceful loco-manipulation tasks such as transporting payloads (0-20N force), cart-pulling (0-100N), and door-opening (0-40N) in the real world.

人形机器人强化学习力控操作双智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。