arXiv:2509.25443cs.RO2025-09被引 2

让机器人像人一样柔韧行走,通过学习调整身体各部位的软硬程度。

CoTaP: Compliant Task Pipeline and Reinforcement Learning of Its Controller with Compliance Modulation

  • 分两阶段训练:先学位置控制,再融合柔性调节机制。
  • 在不同柔硬度下应对外力干扰时表现更稳定,实测有效。
  • 适合需要精准互动的仿人机器人任务,如搬运或协作。

仿人机器人全身运动控制是发挥其固有优势的关键。基于重定向人类运动数据的学习型控制方法为该问题提供了有效途径。然而,由于多数现有人体数据集缺乏受力信息,且学习型机器人控制多以位置为基础,实现与真实环境交互时的合理柔顺性仍具挑战。本文提出柔顺任务流水线(CoTaP):一种在学习型结构中引入柔顺信息的框架。设计了基于模型的双代理强化学习两阶段架构,首先训练基础位置控制器;随后在知识蒸馏阶段,上半身策略结合基于模型的柔顺控制,下半身代理由基础策略引导。上半身控制中,可通过在对称正定(SPD)流形上的柔顺调制,灵活设定并集成任务空间柔顺性,确保系统稳定性。在仿真中验证了该策略可行性,重点对比了不同柔顺设置下对外部扰动的响应效果。

原文摘要 · Abstract (English)

Humanoid whole-body locomotion control is a critical approach for humanoid robots to leverage their inherent advantages. Learning-based control methods derived from retargeted human motion data provide an effective means of addressing this issue. However, because most current human datasets lack measured force data, and learning-based robot control is largely position-based, achieving appropriate compliance during interaction with real environments remains challenging. This paper presents Compliant Task Pipeline (CoTaP): a pipeline that leverages compliance information in the learning-based structure of humanoid robots. A two-stage dual-agent reinforcement learning framework combined with model-based compliance control for humanoid robots is proposed. In the training process, first a base policy with a position-based controller is trained; then in the distillation, the upper-body policy is combined with model-based compliance control, and the lower-body agent is guided by the base policy. In the upper-body control, adjustable task-space compliance can be specified and integrated with other controllers through compliance modulation on the symmetric positive definite (SPD) manifold, ensuring system stability. We validated the feasibility of the proposed strategy in simulation, primarily comparing the responses to external disturbances under different compliance settings.

仿人机器人强化学习柔顺控制运动规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。