X-Loco让机器人同时掌握走路、平衡和摔倒恢复,仅用速度指令控制。
X-Loco: Towards Generalist Humanoid Locomotion Control via Synergetic Policy Distillation
- 通过动态选择专家策略,融合多技能知识训练通用控制模型。
- 在摔倒恢复和复杂地形行走任务中表现优于现有方法。
- 首个仅靠速度指令实现多种运动能力的视觉感知机器人系统。
尽管近期研究在直立行走、摔倒恢复和全身协调等单个机器人技能上取得显著进展,但学习一个能掌握所有这些技能的统一策略仍面临挑战,主要源于动态特性多样性和控制目标冲突。为此,我们提出X-Loco框架,用于训练基于视觉的通用类人机器人运动控制策略。X-Loco首先训练多个专家策略(oracle specialist policies),并采用协同式策略蒸馏机制,结合案例自适应专家选择方法,动态利用多个专家策略指导一个基于视觉的学生策略。该设计使学生策略能够掌握从摔倒恢复到地形穿越、全身协调等多种运动技能。据我们所知,X-Loco是首个展示仅依赖速度命令、无需参考动作轨迹,即可联合实现直立行走、全身协调与摔倒恢复的视觉感知类人机器人运动系统。实验结果表明,该框架在摔倒恢复和地形穿越任务中均表现出色。消融实验证明,该框架能有效利用专家知识并提升学习效率。
原文摘要 · Abstract (English)
While recent advances have demonstrated strong performance in individual humanoid skills such as upright locomotion, fall recovery and whole-body coordination, learning a single policy that masters all these skills remains challenging due to the diverse dynamics and conflicting control objectives involved. To address this, we introduce X-Loco, a framework for training a vision-based generalist humanoid locomotion policy. X-Loco trains multiple oracle specialist policies and adopts a synergetic policy distillation with a case-adaptive specialist selection mechanism, which dynamically leverages multiple specialist policies to guide a vision-based student policy. This design enables the student to acquire a broad spectrum of locomotion skills, ranging from fall recovery to terrain traversal and whole-body coordination skills. To the best of our knowledge, X-Loco is the first framework to demonstrate vision-based humanoid locomotion that jointly integrates upright locomotion, whole-body coordination and fall recovery, while operating solely under velocity commands without relying on reference motions. Experimental results show that X-Loco achieves superior performance, demonstrated by tasks such as fall recovery and terrain traversal. Ablation studies further highlight that our framework effectively leverages specialist expertise and enhances learning efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。