arXiv:2505.20829cs.RO2025-05被引 20

提出首个无需力传感器的足式机器人力-位联合控制统一策略

Learning a Unified Policy for Position and Force Control in Legged Loco-Manipulation

  • 通过强化学习联合建模位置与力控,从历史状态估计力并补偿
  • 在4个复杂接触任务中成功率提升39.5%,优于纯位置控制
  • 适用于四足与人形机器人,增强轨迹模仿学习的接触适应性

机器人在接触丰富的运动操作任务中需同时建模接触力与位置。然而,现有视觉-动作策略常仅关注位置或力控,忽略二者协同学习。本文提出首个无需力传感器的足式机器人统一控制策略,通过在模拟中混合多种位置与力指令及外部干扰,利用强化学习学习从历史机器人状态估计力,并通过位置与速度调整进行补偿。该策略可实现位置跟踪、力施加、力跟踪及柔顺交互等多种操作行为。此外,其力估计模块能有效提升基于轨迹的模仿学习性能,在4个高难度接触任务中成功率较纯位置控制策略提高约39.5%。在四足机械臂与人形机器人上的大量实验验证了该策略在多场景下的通用性与鲁棒性。

原文摘要 · Abstract (English)

Robotic loco-manipulation tasks often involve contact-rich interactions with the environment, requiring the joint modeling of contact force and robot position. However, recent visuomotor policies often focus solely on learning position or force control, overlooking their co-learning. In this work, we propose the first unified policy for legged robots that jointly models force and position control learned without reliance on force sensors. By simulating diverse combinations of position and force commands alongside external disturbance forces, we use reinforcement learning to learn a policy that estimates forces from historical robot states and compensates for them through position and velocity adjustments. This policy enables a wide range of manipulation behaviors under varying force and position inputs, including position tracking, force application, force tracking, and compliant interactions. Furthermore, we demonstrate that the learned policy enhances trajectory-based imitation learning pipelines by incorporating essential contact information through its force estimation module, achieving approximately 39.5% higher success rates across four challenging contact-rich manipulation tasks compared to position-control policies. Extensive experiments on both a quadrupedal manipulator and a humanoid robot validate the versatility and robustness of the proposed policy across diverse scenarios.

足式机器人力控强化学习协同控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。