让机器人动作更真实:用测试时优化提升语言控制的可执行性
TEXEDO : Test Time Scaling for Controller-aware Language-conditioned Humanoid Motion Generation

- 生成多个动作候选,通过物理可行性筛选
- 实测在真实机器人上提升追踪精度与语义对齐度
- 适合关注落地部署的机器人运动生成研究者
语言条件下的运动生成为编程人形机器人提供了有前景的接口,但现有方法多基于经重定向至机器人形态的人类运动数据训练。这类数据虽包含丰富的语义与运动先验,却无法捕捉全身跟踪控制器的细节,如平衡、接触动力学、执行器限制及控制器特有失败模式。因此生成的动作可能语义合理但难以实际执行。本文提出TEXEDO,一种无需更强生成器的测试时缩放框架:给定文本提示后,从预训练生成器采样多个候选动作,选择在物理上可执行且任务对齐的最佳动作。奖励模型结合动态可行性验证器(由全身跟踪滚动推演蒸馏而来,预测物理可执行性)与语义对齐验证器(在学习的联合嵌入空间中衡量文本-动作对齐度)。管道将动态可行性设为硬约束,语义对齐作为可行集内的优化目标。大规模仿真与真实世界部署(基于Unitree G1人形机器人)表明,TEXEDO持续提升追踪保真度与文本对齐度。结果证明,基于地面验证是实现可部署语言引导人形运动生成的有效路径。
原文摘要 · Abstract (English)
Text-conditioned motion generation is a promising interface for programming humanoid robots, yet current generators are often trained on human motion datasets retargeted to robot morphologies. Although such data provides rich semantic and kinematic priors, it fails to capture the nuances of whole-body tracking controllers, including balance, contact dynamics, actuation limits, and controller-specific failure modes. As a result, generated motions can be semantically plausible but difficult or impossible for the robot to execute. We introduce TEXEDO, a test-time scaling framework for humanoid motion generation that improves motion quality without requiring a stronger underlying generator. Given a text prompt, TEXEDO samples multiple candidate motions from a pretrained text-conditioned generator and selects the best motion that is both executable and task-aligned. The reward model combines a dynamic feasibility verifier, distilled from whole-body tracking rollouts to predict physical executability, with a semantic alignment verifier that measures text-motion alignment in a learned co-embedding space. Our pipeline treats dynamic feasibility as a hard constraint and semantic alignment as the selection objective within the feasible set. Through large-scale simulation studies and real-world deployment on a Unitree G1 humanoid robot, we show that TEXEDO consistently improves both tracking fidelity and text alignment. These results demonstrate that grounded verification is an effective path toward deployable language-guided humanoid motion generation. Project website: https://jianuocao.github.io/TEXEDO/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。