AGILE构建全流程机器人学习系统,提升仿真到现实的迁移可靠性
AGILE: A Comprehensive Workflow for Humanoid Loco-Manipulation Learning
- 设计四阶段闭环工作流,整合环境验证、训练、评估与部署
- 在两个硬件平台实现五类技能的稳定仿真到现实迁移
- 支持自动化测试与鲁棒性评估,适合工业级机器人研发团队
近期强化学习进展使仿真中的人形机器人行为表现惊艳,但将其迁移到新机器人仍面临挑战。当前主要瓶颈已不再是仿真吞吐量或算法设计,而是缺乏将环境验证、训练、评估与部署串联成连贯流程的系统化基础设施。为此,我们提出AGILE,一种面向人形机器人运动操作学习的端到端工作流,通过标准化策略开发生命周期,缓解常见的仿真到现实失败模式。AGILE包含四个阶段:(1) 交互式环境验证,(2) 可复现训练,(3) 统一评估,(4) 基于机器人/任务配置描述符的驱动式部署。评估阶段支持基于场景的测试与共享运动质量诊断下的随机推演,实现自动化回归测试与严谨的鲁棒性评估。训练阶段还集成多项训练稳定化与算法增强技术,提升优化稳定性与仿真到现实的迁移能力。借助该流程,我们在两个硬件平台(Unitree G1 和 Booster T1)上验证了五种代表性人形技能——包括行走、恢复、动作模仿与运动操作——均实现一致的仿真到现实迁移。结果表明,标准化的端到端工作流能显著提升人形机器人强化学习开发的可靠性和可复现性。
原文摘要 · Abstract (English)
Recent advances in reinforcement learning (RL) have enabled impressive humanoid behaviors in simulation, yet transferring these results to new robots remains challenging. In many real deployments, the primary bottleneck is no longer simulation throughput or algorithm design, but the absence of systematic infrastructure that links environment verification, training, evaluation, and deployment in a coherent loop. To address this gap, we present AGILE, an end-to-end workflow for humanoid RL that standardizes the policy-development lifecycle to mitigate common sim-to-real failure modes. AGILE comprises four stages: (1) interactive environment verification, (2) reproducible training, (3) unified evaluation, and (4) descriptor-driven deployment via robot/task configuration descriptors. For evaluation stage, AGILE supports both scenario-based tests and randomized rollouts under a shared suite of motion-quality diagnostics, enabling automated regression testing and principled robustness assessment. AGILE also incorporates a set of training stabilizations and algorithmic enhancements in training stage to improve optimization stability and sim-to-real transfer. With this pipeline in place, we validate AGILE across five representative humanoid skills spanning locomotion, recovery, motion imitation, and loco-manipulation on two hardware platforms (Unitree G1 and Booster T1), achieving consistent sim-to-real transfer. Overall, AGILE shows that a standardized, end-to-end workflow can substantially improve the reliability and reproducibility of humanoid RL development.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。