arXiv:2607.02205cs.RO2026-07被引 1

让机器人硬件模拟仿真中的理想动作,实现零样本迁移到真实世界。

Actuator Reality Shaping for Zero-Shot Sim-to-Real Robot Learning

论文配图:Actuator Reality Shaping for Zero-Shot Sim-to-Real Robot Learning
图 1 · 摘自论文原文
  • 用前馈-反馈控制器重塑物理关节的响应行为,匹配仿真中的理想动态。
  • 在高传动比伺服和7轴机械臂上,零样本迁移跟踪误差显著降低。
  • 适用于多种机器人平台,无需任务微调或额外建模,可复用性强。

机器人学习中的仿真到现实迁移常受限于训练时假设的理想执行器动力学与真实电机非线性、依赖硬件的实际行为之间的差异。传统方法通过系统辨识、域随机化或学习执行器模型来提升仿真保真度,而本文提出新范式:执行器现实塑造。不修改仿真以匹配现实,而是将物理执行器的闭环行为调整为匹配仿真中使用的二阶参考动态。通过为每个关节配置双自由度前馈-反馈控制器,解耦参考响应塑造与鲁棒稳定,从而为强化学习策略提供标准化执行器接口。结果表明,仅基于预定参考模型训练的策略可直接零样本部署于真实硬件,无需任务级微调或学习型执行器模型。我们在单关节高传动比伺服(带外部负载)和7自由度机械臂抓取任务中验证该方法,相比标准伺服控制和代表性真实-仿真-现实基线,显著降低仿真到现实的跟踪误差并提升零样本任务表现。进一步在轮腿机器人爬坡和人形机器人行走任务中实现零样本迁移,表明该方法可作为跨多种硬件平台的通用机器人学习接口。

原文摘要 · Abstract (English)

Sim-to-real transfer in robot learning is often limited by discrepancies between the ideal actuator dynamics assumed during policy training and the nonlinear, hardware-dependent behavior of physical motors. While conventional approaches attempt to bridge this gap by increasing simulator fidelity through system identification, domain randomization, or learned actuator models, we introduce an alternative paradigm: actuator reality shaping. Instead of modifying the simulator to match the real world, our method shapes the closed-loop behavior of physical actuators to match the idealized second-order reference dynamics used in simulation. By equipping each joint with a two-degree-of-freedom feedforward--feedback controller, we decouple reference-response shaping from robust stabilization, thereby providing a standardized actuator interface for reinforcement learning policies. As a result, policies trained only with the prescribed reference model can be deployed zero-shot on real hardware without task-level fine-tuning or learned actuator models. We validate the approach on a single-joint high-gear-ratio servo under external loads and a 7-DOF robotic arm reaching task, where actuator reality shaping substantially reduces sim-to-real tracking error and improves zero-shot task performance compared with standard servo-control and representative real-to-sim-to-real baselines. We further demonstrate zero-shot transfer on a wheeled-legged robot driving over a slope and a humanoid robot walking, suggesting that actuator reality shaping can serve as a reusable interface for robot learning across diverse hardware platforms. Project page: https://syamamori.github.io/ActuatorRealityShaping.github.io/

机器人学习零样本迁移执行器建模仿真到现实

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。