arXiv:2603.16188cs.CV2026-03被引 3

用语言控制人形机器人,云端生成动作,边缘端实时执行。

ECHO: Edge-Cloud Humanoid Orchestration for Language-to-Motion Control

  • 云端用扩散模型从语言生成动作,边缘端用强化学习精准跟踪。
  • 生成动作1秒内完成,真实机器人执行零调参,跌倒自动恢复。
  • 适合想用自然语言控制人形机器人的研究者和开发者。

我们提出ECHO,一个面向人形机器人语言驱动全身控制的边缘-云协同框架。云端部署基于扩散模型的文本到动作生成器,根据自然语言指令生成动作参考;边缘端部署强化学习追踪器,在机器人上以闭环方式执行动作。两者通过一种紧凑的38维机器人本体动作表示连接,包含关节角、根部平面速度、高度及连续6D根部姿态,避免推理时从人体模型重定向,且与底层PD控制直接兼容。生成器采用1D卷积UNet,结合CLIP编码的文本特征进行交叉注意力;推理时使用DDIM采样,10步去噪和无分类器引导,可在云端GPU上约1秒内生成动作序列。追踪器采用教师-学生范式:将特权教师策略蒸馏至轻量级学生模型,配备证据适应模块以实现仿真到现实的迁移,进一步通过形态对称性约束和领域随机化增强。内置自主跌倒检测机制,通过机载IMU识别跌倒并从预建动作库中检索恢复轨迹。我们在适配后的HumanML3D基准上评估ECHO,统一机器人域评价器下生成质量优异(FID 0.029,R-Precision Top-1 0.686),同时保持高运动安全性和轨迹一致性。在Unitree G1人形机器人上的真实实验表明,可稳定执行多样语言指令,无需硬件调优。

原文摘要 · Abstract (English)

We present ECHO, an edge--cloud framework for language-driven whole-body control of humanoid robots. A cloud-hosted diffusion-based text-to-motion generator synthesizes motion references from natural language instructions, while an edge-deployed reinforcement-learning tracker executes them in closed loop on the robot. The two modules are bridged by a compact, robot-native 38-dimensional motion representation that encodes joint angles, root planar velocity, root height, and a continuous 6D root orientation per frame, eliminating inference-time retargeting from human body models and remaining directly compatible with low-level PD control. The generator adopts a 1D convolutional UNet with cross-attention conditioned on CLIP-encoded text features; at inference, DDIM sampling with 10 denoising steps and classifier-free guidance produces motion sequences in approximately one second on a cloud GPU. The tracker follows a Teacher--Student paradigm: a privileged teacher policy is distilled into a lightweight student equipped with an evidential adaptation module for sim-to-real transfer, further strengthened by morphological symmetry constraints and domain randomization. An autonomous fall recovery mechanism detects falls via onboard IMU readings and retrieves recovery trajectories from a pre-built motion library. We evaluate ECHO on a retargeted HumanML3D benchmark, where it achieves strong generation quality (FID 0.029, R-Precision Top-1 0.686) under a unified robot-domain evaluator, while maintaining high motion safety and trajectory consistency. Real-world experiments on a Unitree G1 humanoid demonstrate stable execution of diverse text commands with zero hardware fine-tuning.

人形机器人语言控制边缘计算动作生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。