arXiv:2603.17927cs.RO2026-03被引 3

让机器人听懂文字指令并安全走路,不依赖繁琐转换。

RoboForge: Physically Optimized Text-guided Whole-Body Locomotion for Humanoids

  • 用物理约束双向优化生成与控制,避免漂浮、穿模等错误。
  • 在G1机器人上实现92%成功率,比传统方法更稳定精确。
  • 适合想快速部署文本控制机器人的研究者和工程师。

尽管生成模型已能根据文本生成类人动作,但将其转移到人形机器人上执行仍面临挑战。现有流程常受限于动作重定向问题,导致运动质量下降、接触过渡错误频发,且真实动态数据成本高昂。本文提出统一的隐空间驱动框架,通过无重定向、物理优化的流水线,实现从自然语言到全身人形机器人行走的直接映射。核心思想是将生成与控制在物理约束下双向耦合。引入物理合理性优化(PP-Opt)模块作为接口:正向中,以合理性为中心奖励优化教师-学生蒸馏策略,抑制漂浮、滑行、穿透等伪影;反向中,将奖励优化的仿真轨迹转化为高质量显式运动数据,用于微调生成器,使其学习更符合物理规律的隐空间分布。该双向设计形成自提升循环:生成器学会物理合理的隐表示,控制器则能以动力学完整性执行隐空间条件行为。大量实验显示,在Unitree G1上,双向优化显著提升跟踪精度与成功率。在IsaacLab与MuJoCo环境中,隐空间驱动方法在精度与稳定性上持续优于传统显式重定向基线。通过将扩散生成与物理合理性优化结合,本框架为可部署的文本引导人形智能提供了可行路径。

原文摘要 · Abstract (English)

While generative models have become effective at producing human-like motions from text, transferring these motions to humanoid robots for physical execution remains challenging. Existing pipelines are often limited by retargeting, where kinematic quality is undermined by physical infeasibility, contact-transition errors, and the high cost of real-world dynamical data. We present a unified latent-driven framework that bridges natural language and whole-body humanoid locomotion through a retarget-free, physics-optimized pipeline. Rather than treating generation and control as separate stages, our key insight is to couple them bidirectionally under physical constraints.We introduce a Physical Plausibility Optimization (PP-Opt) module as the coupling interface. In the forward direction, PP-Opt refines a teacher-student distillation policy with a plausibility-centric reward to suppress artifacts such as floating, skating, and penetration. In the backward direction, it converts reward-optimized simulation rollouts into high-quality explicit motion data, which is used to fine-tune the motion generator toward a more physically plausible latent distribution. This bidirectional design forms a self-improving cycle: the generator learns a physically grounded latent space, while the controller learns to execute latent-conditioned behaviors with dynamical integrity.Extensive experiments on the Unitree G1 humanoid show that our bidirectional optimization improves tracking accuracy and success rates. Across IsaacLab and MuJoCo, the implicit latent-driven pipeline consistently outperforms conventional explicit retargeting baselines in both precision and stability. By coupling diffusion-based motion generation with physical plausibility optimization, our framework provides a practical path toward deployable text-guided humanoid intelligence.

人形机器人文本生成物理优化运动控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。