让机器人在真实世界中更灵活操作,自动调控制器参数。
DexCtrl: Towards Sim-to-Real Dexterity with Adaptive Controller Learning
- 边执行边自适应调整控制器参数,减少仿真到现实的偏差。
- 在多种需要力控制的任务上表现更好,无需大量手动调参。
- 适合需要精细力控的机器人操作,如抓取、翻转等场景。
灵巧操作近年来取得显著进展,策略可在仿真中完成许多复杂且依赖接触的任务。然而,将这些策略从仿真迁移到真实世界仍面临重大挑战。一个重要问题是底层控制器动态不匹配:相同轨迹在不同控制参数下会产生截然不同的接触力和行为。现有方法通常依赖人工调参或控制器随机化,既费时又任务特定,并带来训练困难。本文提出一种联合学习动作与控制器参数的框架,基于轨迹和控制器的历史信息进行自适应调整。该机制使策略在执行过程中能自动调节控制参数,从而在无需大量人工调参或过度随机化的情况下缓解仿真到现实的差距。此外,通过将控制器参数显式作为观测输入,方法增强了对接触力的推理能力,提升了真实场景下的鲁棒性。实验表明,该方法在多种涉及变力条件的灵巧操作任务中实现了更好的迁移性能。
原文摘要 · Abstract (English)
Dexterous manipulation has seen remarkable progress in recent years, with policies capable of executing many complex and contact-rich tasks in simulation. However, transferring these policies from simulation to real world remains a significant challenge. One important issue is the mismatch in low-level controller dynamics, where identical trajectories can lead to vastly different contact forces and behaviors when control parameters vary. Existing approaches often rely on manual tuning or controller randomization, which can be labor-intensive, task-specific, and introduce significant training difficulty. In this work, we propose a framework that jointly learns actions and controller parameters based on the historical information of both trajectory and controller. This adaptive controller adjustment mechanism allows the policy to automatically tune control parameters during execution, thereby mitigating the sim-to-real gap without extensive manual tuning or excessive randomization. Moreover, by explicitly providing controller parameters as part of the observation, our approach facilitates better reasoning over force interactions and improves robustness in real-world scenarios. Experimental results demonstrate that our method achieves improved transfer performance across a variety of dexterous tasks involving variable force conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。