arXiv:2603.07516cs.ROcs.AI2026-03被引 2

让机器人像人一样精准操控物体,实现在真实世界稳定作业。

InterReal: A Unified Physics-Based Imitation Framework for Learning Human-Object Interaction Skills

  • 基于物理仿真构建交互动作数据增强,提升抓取稳定性
  • 通过自动奖励学习机制,实现高精度物体操控任务
  • 在真实机器人上验证,适合需要精细人物交互的场景

交互是人形机器人核心能力之一。现有框架多聚焦于非交互式全身控制,限制了实际应用。本文提出InterReal,一种统一的基于物理的模仿学习框架,用于真实世界中的人-物交互(HOI)控制。该框架使机器人能够追踪人-物交互参考动作,从而学习精细交互技能并部署于现实环境。首先,引入包含手物接触约束的HOI动作数据增强方法,提升在物体扰动下的策略稳定性;其次,提出自动奖励学习器以解决大规模奖励设计难题,由元策略依据关键跟踪误差指标探索并分配奖励信号至底层强化学习目标,有效提升交互策略学习效率。在箱子拾取与推移等HOI任务上的实验表明,InterReal相比近期基线方法实现了最佳跟踪精度和最高任务成功率。此外,在真实机器人Unitree G1上验证了该框架的实用性与鲁棒性,超越仿真环境限制。

原文摘要 · Abstract (English)

Interaction is one of the core abilities of humanoid robots. However, most existing frameworks focus on non-interactive whole-body control, which limits their practical applicability. In this work, we develop InterReal, a unified physics-based imitation learning framework for Real-world human-object Interaction (HOI) control. InterReal enables humanoid robots to track HOI reference motions, facilitating the learning of fine-grained interactive skills and their deployment in real-world settings. Within this framework, we first introduce a HOI motion data augmentation scheme with hand-object contact constraints, and utilize the augmented motions to improve policy stability under object perturbations. Second, we propose an automatic reward learner to address the challenge of large-scale reward shaping. A meta-policy guided by critical tracking error metrics explores and allocates reward signals to the low-level reinforcement learning objective, which enables more effective learning of interactive policies. Experiments on HOI tasks of box-picking and box-pushing demonstrate that InterReal achieves the best tracking accuracy and the highest task success rate compared to recent baselines. Furthermore, we validate the framework on the real-world robot Unitree G1, which demonstrates its practical effectiveness and robustness beyond simulation.

人机交互物理模拟强化学习机器人控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。