arXiv:2604.24916cs.ROcs.AI2026-04中稿 · RSS2026

用摩擦感知强化学习让球形机器人从仿真直接跑上真实硬件

asRoBallet: Closing the Sim2Real Gap via Friction-Aware Reinforcement Learning for Underactuated Spherical Dynamics

论文配图:asRoBallet: Closing the Sim2Real Gap via Friction-Aware Reinforcement Learning for Underactuated Spherical Dynamics
图 1 · 摘自论文原文
  • 在仿真中精确建模轮子与地面的摩擦和振动,解决真实世界差异问题
  • 零样本迁移实现仿真到硬件的直接部署,球形机器人可稳定行走
  • 低成本改造旧设备,普通人用手机就能操控复杂人形动作

我们提出asRoBallet,据知是首个部署于类人球形机器人硬件平台上的端到端强化学习(RL)行走策略。传统球形机器人常作为欠驱动与非完整控制的基准,但其真实世界中的轮-球-地板摩擦模型复杂,导致仿真到现实的差距显著。尽管现有研究在3D平衡上使用LQR与MPC取得成功,但将强化学习应用于实际球形机器人仍受限于接触建模不准确、执行器延迟与抖动以及安全硬件探索难题。本研究构建了高保真MuJoCo仿真环境,显式建模ETH型全向轮的离散滚轮力学,捕捉此前被忽略的寄生振动与接触不连续性。同时提出摩擦感知强化学习框架,通过掌握轮-球与球-地界面的滚动、侧向及扭转摩擦通道,实现零样本仿真到现实的迁移。asRoBallet通过减法重构设计,复用过约束四足机器人关键部件,并集成新结构框架,低成本打造稳健研究平台。此外,开发通用iOS生态系统,将消费电子转化为低延迟接口,单操作员即可通过自然动作流畅操控人形机器人完成复杂动作。

原文摘要 · Abstract (English)

We introduce asRoBallet, to the best of our knowledge, the first end-to-end reinforcement learning (RL) locomotion policy deployed on a humanoid ballbot hardware platform. Historically, ballbots have served as a canonical benchmark for underactuated and nonholonomic control, which are characterized by a reality gap in complex friction models for wheel-ball-floor interactions. While current literature demonstrates successful handling of 3D balancing with LQR and MPC, transitioning to actual hardware for a humanoid ballbot using RL is currently hindered by critical gaps in contact modeling, actuator latency & jitter, and safe hardware exploration. This study proposes a high-fidelity MuJoCo simulation that explicitly models the discrete roller mechanics of ETH-type omni-wheels, thereby capturing parasitic vibrations and contact discontinuities that have previously been ignored. We also developed a Friction-Aware Reinforcement Learning framework that achieves zero-shot Sim2Real transfer by mastering the coupled rolling, lateral, and torsional friction channels at the wheel-ball and ball-floor interfaces. We designed asRoBallet through subtractive reconfiguration, repurposing key components from an overconstrained quadruped and integrating them into a newly designed structural frame to achieve a robust research platform at low cost. We also developed a generalized iOS ecosystem that transforms consumer electronics into a low-latency interface, enabling a single operator to orchestrate expressive humanoid maneuvers via intuitive natural motion.

强化学习球形机器人仿真迁移摩擦建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。