arXiv:2509.14932cs.ROcs.LG2025-09中稿 · ICRA被引 9

打造轻量机器人学习生态,打通仿真与真实世界训练瓶颈

Robot Control Stack: A Lean Ecosystem for Robot Learning at Scale

  • 构建模块化分层架构,统一模拟与物理机器人接口
  • 支持大规模仿真训练和真实场景部署,实现高效迁移到现实
  • 适合研究通用机器人策略的学者,尤其关注仿真到现实迁移

视觉-语言-动作模型(VLAs)标志着机器人学习的重大转变:用大规模数据收集和特定场景微调替代专用架构与任务定制组件。在此以模型为中心、可扩展训练为核心的机器学习流程中,传统机器人软件框架成为瓶颈,而机器人仿真对真实实验的过渡支持有限。为此,本文提出机器人控制栈(RCS),一个从零开始设计的轻量级生态系统,专为支持大规模通用策略的机器人学习研究而建。其核心是模块化且易于扩展的分层架构,提供模拟与物理机器人统一接口,促进仿真到现实的迁移。尽管体积小、依赖少,但功能完整,既支持真实世界实验,也支持大规模仿真训练。贡献有二:一是提出RCS架构并阐述设计原则;二是评估其在VLA与强化学习策略开发周期中的可用性与性能。实验还对Octo、OpenVLA和Pi Zero在多机器人平台上的表现进行了全面评估,揭示了仿真数据如何提升真实世界策略性能。代码、数据集、权重与视频已公开于 https://robotcontrolstack.github.io/

原文摘要 · Abstract (English)

Vision-Language-Action models (VLAs) mark a major shift in robot learning. They replace specialized architectures and task-tailored components of expert policies with large-scale data collection and setup-specific fine-tuning. In this machine learning-focused workflow that is centered around models and scalable training, traditional robotics software frameworks become a bottleneck, while robot simulations offer only limited support for transitioning from and to real-world experiments. In this work, we close this gap by introducing Robot Control Stack (RCS), a lean ecosystem designed from the ground up to support research in robot learning with large-scale generalist policies. At its core, RCS features a modular and easily extensible layered architecture with a unified interface for simulated and physical robots, facilitating sim-to-real transfer. Despite its minimal footprint and dependencies, it offers a complete feature set, enabling both real-world experiments and large-scale training in simulation. Our contribution is twofold: First, we introduce the architecture of RCS and explain its design principles. Second, we evaluate its usability and performance along the development cycle of VLA and RL policies. Our experiments also provide an extensive evaluation of Octo, OpenVLA, and Pi Zero on multiple robots and shed light on how simulation data can improve real-world policy performance. Our code, datasets, weights, and videos are available at: https://robotcontrolstack.github.io/

机器人学习仿真到现实大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。