arXiv:2607.18154cs.RO2026-07

通过逆向提取未观测动态信息,实现仿真与现实间更精准的物理迁移。

World Translation: Minimizing Sim-to-Real Gap with Backward Dynamics Extraction and Unpaired Domain Translation

论文配图:World Translation: Minimizing Sim-to-Real Gap with Backward Dynamics Extraction and Unpaired Domain Translation
图 1 · 摘自论文原文
  • 逆向从真实过渡中提取隐藏动态特征,解决部分可观测问题。
  • 在无历史线索的突发接触场景下,动态建模精度显著优于基线。
  • 适用于复杂机器人平台,尤其适合难靠观测推断状态的场景。

仿真与现实之间的差距仍是部署仿真训练机器人策略时的核心挑战。现有真实到仿真方法从真实侧缩小差距,通过真实数据学习转移动态模型。但这类方法面临部分可观测性问题:相同观测可能因不可见因素导致不同转移。现有方法假设这些因素可从观测历史恢复,但在突发接触等无预警事件中可能失效。为此,我们提出「World Translation」,利用仿真器与学习模型的互补优势:仿真器确定但物理不完美,学习模型准确但受部分可观测性限制。不从前向预测转移,而是从观测到的转移逆向提取不可见动态信息,将其作为无配对域翻译问题,在保留动态内容的同时迁移域风格。在人形、四足和机械臂平台上的实验表明,本方法在动态建模精度上优于基线,尤其在无法从观测历史恢复不可见因素时提升最显著。在Go2四足机器人上的真实部署验证了策略迁移性能的提升。

原文摘要 · Abstract (English)

The gap between simulation and reality remains a fundamental challenge in deploying simulation-trained robotic policies in the real world. Real-to-sim methods narrow this gap from the real side, learning transition dynamics from real data to build a more realistic digital world. Learned dynamics models are their dominant instance. Such methods, however, face a partial observability problem: the same observation may branch to different transitions due to unobservable factors. Existing methods assume these factors can be recovered from observation history. However, this may fail whenever observation history is uninformative, such as a sudden contact event with no prior warning. To address this limitation, we propose \textit{World Translation}, which exploits a complementary strength of simulators and learned dynamics. Simulators are deterministic but physically imperfect, while learned models are accurate but underdetermined under partial observability. Rather than predicting transitions forward from history, we extract the unobservable dynamics information backward from an observed transition, then translate this feature across simulation and reality as an unpaired domain-translation problem that preserves dynamics content while transferring domain style. Experiments across humanoid, quadruped, and manipulator platforms show that our method achieves more accurate dynamics modeling than baselines, with the largest gains when unobservable factors cannot be recovered from observation history. Real-robot deployment on Go2 quadruped confirms improved policy transfer.

Sim-to-Real动态建模机器人无配对翻译

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。